We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Construct validity and fairness of an operational listening test with World Englishes.
- Authors
Nishizawa, Hitoshi
- Abstract
In this study, I investigate the construct validity and fairness pertaining to the use of a variety of Englishes in listening test input. I obtained data from a post-entry English language placement test administered at a public university in the United States. In addition to expectedly familiar American English, the test features Hawai'i, Filipino, and Indian English, which are expectedly less familiar to our test takers, but justified by the context. I used confirmatory factor analysis to test whether the category of unfamiliar English items formed a latent factor distinct from the other category of more familiar American English items. I used Rasch-based differential item functioning analysis to examine item biases as a function of examinees' place of origin. The results from the confirmatory factor analysis suggested that the unfamiliar English items tapped into the same underlying construct as the familiar English items. The Rasch-based differential item functioning analysis revealed many instances of item bias among unfamiliar English items with higher proportions of item biases for items targeting narrow comprehension than broad comprehension. However, at the test level, the unfamiliar English items did not substantially influence raw total scores. These findings offer support for using a variety of Englishes in listening tests.
- Subjects
ENGLISH language in foreign countries; EDUCATIONAL evaluation; CONFIRMATORY factor analysis; AMERICAN English language; TERMS &; phrases
- Publication
Language Testing, 2023, Vol 40, Issue 3, p493
- ISSN
0265-5322
- Publication type
Article
- DOI
10.1177/02655322221137869