Validation of Persian Translation of the Intercultural Sensitivity Scale Using Rasch Model

Elahe Moradi

doi:10.29333/ejecs/374

Authors

Elahe Moradi

DOI:

https://doi.org/10.29333/ejecs/374

Keywords:

intercultural sensitivity, Rasch Rating Scale model, unidimensionality, validity

Abstract

This study subjected the Intercultural Sensitivity scale consisting of 24 items to Rasch analysis in a sample of 200 participants. The scale was translated into Persian and administered to graduate and undergraduate university students. Analysis of data showed that there were no misfitting items. Furthermore, no item manifested gender differential item functioning (DIF). All the thresholds were ordered and respondents could distinguish well between categories of the scale. The results of principal component analysis (PCA) of standardized residuals revealed that there were two contrasts with eigenvalues above two. Deleting positively and negatively loading items separately did not improve model fit. Thus, the content of items was investigated and it became clear that most of the positively loading items covered those items which have negative content and conversely, negatively loading items encompassed the items which have positive content. This brings about two psychometric dimensions in this scale. 1) Wording of the items revealed that the existence of items with negative wording in the scale results in statistical artifacts, and 2) The secondary dimension here could be interpreted to be an artifact of the wording. It was concluded that the scale is unidimensional and enjoys acceptable psychometric properties.

Downloads

Download data is not yet available.

References

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573. http://dx.doi.org/10.1007/BF02293814 DOI: https://doi.org/10.1007/BF02293814

Baghaei, P. (2008). The Rasch model as a construct validation tool. Rasch Measurement Transactions, 22, 1145-1146.

Baghaei, P. & Cassady, J. (2014). Validation of the Persian translation of the cognitive test anxiety scale. SAGE Open, 4, 1-11. http://dx.doi.org/10.1177/2158244014555113 DOI: https://doi.org/10.1177/2158244014555113

Baghaei, P., & Shoahosseini, R. (2019). A note on the Rasch model and the instrument-based account of validity. Rasch Measurement Transactions, 32, 1705-1708.

Baghaei, P., Hohensinn, C., & Kubinger, K. D. (2014). The Persian adaptation of the foreign language reading anxiety scale: A psychometric analysis. Psychological Reports, 114, 315-325. https://dx.doi.org/10.2466/08.11.PRO.114k16w1 DOI: https://doi.org/10.2466/08.11.PR0.114k16w1

Bhawuk, D. P. S., & Brislin, R. (1992). The measurement of intercultural sensitivity using the concepts of individualism and collectivism. International Journal of Intercultural Relations, 16, 413-436. http://dx.doi.org/10.1016/0147-1767(92)90031-O DOI: https://doi.org/10.1016/0147-1767(92)90031-O

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences. Lawrence Erlbaum.

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human Sciences (3rd ed.). L. Erlbaum. http://dx.doi.org/10.4324/9781410600127 DOI: https://doi.org/10.4324/9781410600127

Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111(4), 1061-1071. http://dx.doi.org/10.1037/0033-295X.111.4.1061 DOI: https://doi.org/10.1037/0033-295X.111.4.1061

Carothers, D. (2018). A culture of equality?. Journal of Culture and Values in Education, 1(2), 42-57. https://doi.org/10.46303/jcve.01.02.3 DOI: https://doi.org/10.46303/jcve.01.02.3

Chen, G. M., & Starosta, W. J. (1996). Intercultural communication competence: A synthesis. Communication Yearbook, 19, 353-383. http://dx.doi.org/10.1080/23808985.1996.11678935 DOI: https://doi.org/10.1080/23808985.1996.11678935

Chen, G. M., & Starosta, W. J. (2000). The development and validation of the intercultural communication sensitivity scale. Human Communication, 3, 1-15.

Chi, R., & Suthers, D. (2015). Assessing intercultural communication competence as a relational construct using social network analysis. International Journal of Intercultural Relations. https://doi.org/10.1016/j.ijintrel.2015.03.011 DOI: https://doi.org/10.1016/j.ijintrel.2015.03.011

Cordery, J. L., & Sevastos, P. P. (1993). Responses to the original and revised Job Diagnostic Survey: Is education a factor in responses to negatively worded items? Journal of Applied Psychology, 78, 141-143. http://dx.doi.org/10.1037/0021-9010.78.1.141 DOI: https://doi.org/10.1037/0021-9010.78.1.141

Delante, N. (2020). Classroom teaching as an intercultural communication phenomenon: A thematic analysis of a foreign teacher’s rhetorical practices as communication dynamic. Journal of Intercultural Communication Research. https://doi.org/10.1080/17475759.2020.1790406 DOI: https://doi.org/10.1080/17475759.2020.1790406

Dong, Q., Day, K., & Collaco, C. (2008). Overcoming ethnocentrism through developing intercultural sensitivity and multiculturalism [Paper presentation]. International Communication Association Conference, Montreal.

Flores, H., I. A., & Palacios, M, N. (2018). Cultural and intercultural education: Experiences of ethnoeducational teachers in Colombia. Australian Journal of Teacher Education, 43(7). http://dx.doi.org/10.14221/ajte.2018v43n7.4 DOI: https://doi.org/10.14221/ajte.2018v43n7.4

Fritz, W., Graf, A., Hentze, J., Mollenberg, A., & Chen, G. M. (2005). An examination of Chen and Starosta’s model of intercultural sensitivity in Germany and the United States. Intercultural Communication Studies, 14(1), 53-65.

Fritz, W., Mollenberg, A., & Chen, G. M. (2001). Measuring intercultural sensitivity in different cultural context. Intercultural Communication Studies, 11(2). http://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1019&context=com_facpubs

Hackman, J. R. & Oldham, G. R. (1975). Development of the Job Diagnostic Survey. Journal of Applied psychology, 60, 159-l70. http://dx.doi.org/10.1037/h0076546 DOI: https://doi.org/10.1037/h0076546

Halpern, C. (2018). Multicultural for who? A review of a comprehensive multicultural textbook. Journal of Culture and Values in Education, 1(2), 58-62. https://doi.org/10.46303/jcve.01.02.4 DOI: https://doi.org/10.46303/jcve.01.02.4

Idaszak, J. R., & Drasgow, F. (1987). A revision of the Job Diagnostic Survey: Elimination of a measurement artifact. Journal of Applied Psychology, 72, 69-74. http://dx.doi.org/10.1037/0021-9010.72.1.69 DOI: https://doi.org/10.1037/0021-9010.72.1.69

Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3, 103-122.

Linacre, J. M. (2009). A user’s guide to WINSTEPS. MESA Press.

Linacre, J.M. (2006). WINSTEPS Rasch Measurement Computer Program. Chicago: Winsteps.com.

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum Associates. http://dx.doi.org/10.4324/9780203056615 DOI: https://doi.org/10.4324/9780203056615

Magazine, S. L., Williams, L. J. & Williams, M. L. (in press). A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen’s. Affective and Continuance Commitment Scale. Educational &

McGee, G. W., Ferguson, C. E. Jr., & Seers, A. (1989). Role conflict and role ambiguity: Do the scales measure these two constructs? Journal of Applied Psychology, 74, 815-818.http://dx.doi.org/10.1037/0021-9010.74.5.815 DOI: https://doi.org/10.1037/0021-9010.74.5.815

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-104). Macmillan.

Meyer, J. P., & Allen, N. J. (1984). Testing the “side-bet theory” of organizational commitment: Some methodological considerations. Journal of Applied Psychology, 69, 372-378. http://dx.doi.org/10.1037/0021-9010.69.3.372 DOI: https://doi.org/10.1037/0021-9010.69.3.372

Moradi, E., & Ghabanchi, Z. (2019). Intercultural sensitivity: A comparative study among business English undergraduate learners in two countries of Iran and China. Journal of Ethnic and Cultural Studies.6(3), 134-146. http://dx.doi.org/10.29333/ejecs/278 DOI: https://doi.org/10.29333/ejecs/278

Peng, S. Y. (2006). A comparative perspective of intercultural sensitivity between college students and multinational employees in China. Multicultural Perspectives, 8(3), 38-45. http://dx.doi.org/10.1207/s15327892mcp0803_7 DOI: https://doi.org/10.1207/s15327892mcp0803_7

Peng, S. Y., Rangsipaht, S., & Thaipakee, S. (2005). Measuring intercultural sensitivity: A comparative study of ethnic Chinese and Thai nationals. Journal of Intercultural Communication Research, 34(2), 119-137.

Psychological Measurement. http://dx.doi.org/10.1177/0013164496056002005 DOI: https://doi.org/10.1177/0013164496056002005

Rizzo, J. R., House, R. J., & Lirtzman, S. I. (1970). Role conflict and ambiguity in complex organizations. Administrative Science Quarterly, 15, 150-163. http://dx.doi.org/10.2307/2391486S DOI: https://doi.org/10.2307/2391486

Samovar, L. A., & Porter, R. E. (1991). Communications between cultures. Wadsworth.

Satio, Y., Horwitz, E. K., & Garza, T. J. (1999). Foreign language reading anxiety. Modern Language Journal, 83, 202-218. DOI: https://doi.org/10.1111/0026-7902.00016

Schmitt, N., & Stults, D. M. (1985). Factors defined by negatively keyed items: The results of careless respondents? Applied Psychological Measurement, 9, 367-373. http://dx.doi.org/10.1177/014662168500900405 DOI: https://doi.org/10.1177/014662168500900405

Schriesheim, C. A., & Hill, K. D. (1981). Controlling acquiescence response bias by item reversals: The effect on questionnaire validity. Educational and Psychological Measurement, 41, 1101-1114. http://dx.doi.org/10.1177/001316448104100420 DOI: https://doi.org/10.1177/001316448104100420

Schriesheim, C. A., Elsenback, R. J., & Hill, K. D. (1991). The effect of negation and polar opposite item reversals on questionnaire reliability and validity: An experimental investigation. Educational and Psychological Measurement, 51, 67-78. http://dx.doi.org/10.1177/0013164491511005 DOI: https://doi.org/10.1177/0013164491511005

Spector, P. E. (1988). Development of the Work Locus of Control Scale. Journal of Occupational Psychology, 61, 335-340. http://dx.doi.org/10.1111/j.2044-8325.1988.tb00470.x DOI: https://doi.org/10.1111/j.2044-8325.1988.tb00470.x

Spector, P. E. (1992). Summated rating scale construction: An introduction. Sage. DOI: https://doi.org/10.4135/9781412986038

Spector. P. E., Van Katwyk. P. T., Brannick. M. T., & Chen. P. T. (1997). When two factors don’t reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659-677. http://dx.doi.org/10.1177/014920639702300503 DOI: https://doi.org/10.1177/014920639702300503

Tétreault, S., Bétrisey, C., Brisset, C., Gulfi, A., Schaer, M., Leanza, Y., & Kühne, N. (2020). Intercultural Experiences Prior to the Educational Program: Occupational Therapy and Social Work Students. Journal of Culture and Values in Education. https://doi.org/10.46303/jcve.2020.6 DOI: https://doi.org/10.46303/jcve.2020.6

Vu, T. (2019). Theoretical Constructs and Practical Strategies for Intercultural Communication. Journal of Curriculum Studies Research, 1(1), 43-53. https://doi.org/10.46303/jcsr.01.01.4 DOI: https://doi.org/10.46303/jcsr.01.01.4

West, L. (2009). Evaluating the intercultural sensitivity scale with counselors in international schools [Unpublished doctoral dissertation]. Regent University.

Wolf, E. W., & Smith, E. V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part I-instrument development tools. Journal of Applied Measurement, 8, 204-234.

Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. MESA Press.