Reflective Process and Intercultural Effectiveness: A Case Study

Authors

  • Victor Savicki Western Oregon University
  • Michele V. Price Michele V. Price Consulting: Solutions for Education Abroad

DOI:

https://doi.org/10.36366/frontiers.v34i4.505

Keywords:

Reflection, Intercultural Learning, Education Abroad, Intercultural Effectiveness

Abstract

Despite the importance of reflection as a crucial element in stimulating successful student experience in study abroad, attempts to define and measure this construct have been fraught with difficulty. This article describes one approach to defining and validating a measure of the reflective process. University students who participated in a semester-long reflection course wrote weekly reflective essays. Four, multi-scale factor analyzed cognitive complexity factors derived from the Linguistic Inquiry and Word Count (LIWC) content analysis software formed key study variables: Immediacy, Interaction, Making Sense, Making Distinctions. These four factors aligned well with key components of reflection. The cognitive complexity factors were related to pre and post student intercultural effectiveness using the Intercultural Effectiveness Scale following a criterion validity framework. The LIWC cognitive complexity factor profiles fit well with student intercultural effectiveness scores when evaluated against reflection theory and previous research. The LIWC offers a measurement alternative that is objective, easy to use, and scalable to larger samples and more frequent administration. Thus, measurement may be harnessed in the service of formative evaluation and evidenced-based program development.

Abstract in Spanish

A pesar de la importancia de la reflexión como elemento crucial para estimular la experiencia estudiantil exitosa en el extranjero, los intentos de definir y medir este constructo han estado plagados de dificultades. Este artículo describe un enfoque para definir y validar una medida del proceso reflexivo. Los estudiantes universitarios que participaron en un curso de reflexión de un semestre de duración escribieron ensayos reflexivos semanales. Cuatro factores de complejidad cognitiva analizados en múltiples escalas derivados del software de análisis de contenido Linguistic Inquiry and Word Count (LIWC) formaron variables clave del estudio: Inmediatez, Interacción, Dar Sentido, Hacer Distinciones. Estos cuatro factores se alinearon bien con los componentes clave de la reflexión. Los factores de complejidad cognitiva fueron relacionados con la efectividad intercultural del estudiante antes y después del curso utilizando la Escala de Efectividad Intercultural siguiendo un marco de validez de criterio. Los perfiles de factores de complejidad cognitiva de LIWC encajan bien con las puntuaciones de efectividad intercultural de los estudiantes cuando se evalúan frente a la teoría de la reflexión y la investigación previa. El LIWC ofrece una alternativa de medición que es objetiva, fácil de usar y escalable a muestras más grandes y una administración más frecuente. Por lo tanto, la medición puede aprovecharse al servicio de la evaluación formativa y el desarrollo de programas basados en evidencia.

Downloads

Download data is not yet available.

Author Biographies

Victor Savicki, Western Oregon University

Victor Savicki is Professor of Psychology, Emeritus at Western Oregon University. Twenty-eight of his peer reviewed publications emphasize some aspect of culture, including the books Burnout Across Thirteen Cultures (2002); Developing Intercultural Competence and Transformation (2008) and Assessing Study Abroad (2015). His entry in the Encyclopedia of Intercultural Competence (2015) "Stress, Coping and Adjustment in Intercultural Competence" synthesizes his views on study abroad student development. His current research interest is reflection from a constructivist viewpoint.

Michele V. Price, Michele V. Price Consulting: Solutions for Education Abroad

Michele V. Price is Emeritus Director of Study Abroad, Western Oregon University where she worked in international education for over 20 years. Now she is owner of Michele V. Price Consulting: Solutions for Education Abroad. She often has served as an administrator for study abroad programs and participated in many site visits and site evaluations around the world for study abroad organizations. She continues to do research in the area of study abroad student reflection.

References

Altshuler, L., Sussman, N. M., & Kachur, E. (2003). Assessing changes in intercultural sensitivity among physician trainees using the intercultural development inventory. International Journal of Intercultural Relations, 27,387-401. https://doi.org/10.1016/S0147-1767(03)00029-4

Bennett, J. M., Bennett, M. J., & Stillings, K. (1977). Description, interpretation, and evaluation: Facilitators’ guidelines. http://intercultural.org/training-and-assessment-tools.html#DIE

Bennett, M. J. (1993). Towards ethnorelativism: A developmental model of intercultural sensitivity. In R. M. Paige (Ed.), Education for the intercultural experience (2nd ed., pp. 21–71). Yarmouth, ME: Intercultural Press.

Bennett, M. J. (2012). Paradigmatic assumptions and a developmental approach to intercultural learning. In M. Vande Berg, R. M. Paige, & K. H. Lou (Eds). Student Learning Abroad: What our students are learning, what they're not, and what we can do about it (pp. 90-114). Sterling, VA: Stylus Publishing.

Brewer, E. & Moore, J. (2015). Where and how do students learn abroad? In V. Savicki & E. Brewer (Eds.). Assessing Study Abroad: Theory, Tools, and Practice (pp. 145-161). Sterling, VA: Stylus Publishing.

Feedback Report: The intercultural effectiveness scale, pp 8-13, (2017). https://www.kozaigroup.com/wp-content/uploads/2017/11/IES_IndividualReport_Jun2017.pdf

Fosnot, C. T. & Perry, R. S. (2005). Constructivism: A psychological theory of learning. In C. T. Fosnot (Ed.) Constructivism: Theory, Perspectives, and Practice, 2nd ed. 8-38. Teacher’s College Columbia University.

Gillespie, J., Ciner, E & Schodt, D. (2015). Engaging stakeholders in assessment of student learning in off-campus programs. In V. Savicki & E. Brewer (Eds.). Assessing Study Abroad: Theory, Tools, and Practice (pp. 262-276). Stylus Publishing.

Hunter, A. (2008). Transformative learning in international education. In V. Savicki, (Ed.). Developing Intercultural Competence and Transformation: Theory, Research, and Application in International Education (pp. 92-107). Stylus Publishing.

Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38, 319-342. https://doi.org/10.1111/j.1745-3984.2001.tb01130.x

Kolb, D. (1984). Experiential learning as the science of learning and development. Prentice Hall.

LeBoutillier, N. & Barry, R. (2018). Psychological mindedness, personality and creative cognition. Creativity Research Journal, 30, 78-84. https://doi.org/10.1080/10400419.2018.1411440

Mendenhall, M. E., Stevens, M. J., Bird, A., Oddou, G. R. & Osland, J. (2012). Specification of the content domain of the Intercultural Effectiveness Scale. The Kozai Monograph Series, 1(3), 1-26.

Mezirow, J. (1991). Transformative dimensions of adult learning. Jossey-Bass.

Paige, R.M. (2015). Interventionist models for study abroad. In J.M. Bennett (Ed.), SAGE Encyclopedia of Intercultural Competence. (pp. 563-568). SAGE Publications.

Pennebaker, J. W., Booth, R. J., & Francis, M. E. (2007). Linguistic Inquiry and Word Count: LIWC [Computer software]. LIWC.net.

Pennebaker, J. W., Chung, C. K., Ireland, M., Gonzales, A., & Booth, R. J. (2007). The development and psychometric properties of LIWC2007 [LIWC manual]. LIWC.net.

Pennebaker, J. W. & King, L.A. (1999). Linguistic styles: Language use as an individual difference. Journal of Personality and Social Psychology, 77, 1296-1312. https://psycnet.apa.org/doi/10.1037/0022-3514.77.6.1296

Robinson, L. Jr. (2021). Investigating critical thinking disposition, self-efficacy, self-regulation, and self-identity amongst online students. College Student Journal, 55, 325-337.

Savicki, V. & Price, M. V. (2015). Student reflective writing: Cognition and affect before, during, and after study abroad. Journal of College Student Development, 56, 587-601. http://doi.org/10.1353/csd.2015.0063

Savicki, V. & Price, M. V. (2017). Components of reflection: A longitudinal analysis of study abroad student blog posts. Frontiers: The Interdisciplinary Journal of Study Abroad, XXIX, 51-62. https://doi.org/10.36366/frontiers.v29i2.392

Savicki, V. & Price, M. V. (2018). Guiding reflection on cultural experience: Before, during, and after study abroad. In S. L. Pasquarelli, R. A. Cole., & M. Tyson, (Eds.) Passport to Change: Designing Academically Sound, Culturally Relevant Short Term Faculty-Led Study Abroad Programs. Stylus Publishing.

Savicki, V. & Price, M. V. (2021). Reflection in transformative learning: The challenge of measurement. Journal of Transformative Education: Special Issue on Assessment of Transformative Learning. 19, 366–382. https://doi.org/10.1177/15413446211045161

Tausczik, Y. R. & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29, 24-54. https://doi.org/10.1177/0261927X09351676

Vande Berg, M., Paige, R. M., & Lou, K. H. (2012). Student learning abroad: Paradigms and assumptions. In M. Vande Berg, R. M. Paige, & K. H. Lou (Eds). Student Learning Abroad: What our students are learning, what they're not, and what we can do about it., (pp. 90-114). Stylus Publishing.

Downloads

Published

2022-11-18

How to Cite

Savicki, V., & Price, M. (2022). Reflective Process and Intercultural Effectiveness: A Case Study. Frontiers: The Interdisciplinary Journal of Study Abroad, 34(4), 6–25. https://doi.org/10.36366/frontiers.v34i4.505

Issue

Section

Research Articles

Most read articles by the same author(s)