We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
The contribution of test-takers’ speech content to scores on an English oral proficiency test.
- Authors
Sato, Takanori
- Abstract
The content that test-takers attempt to convey is not always included in the construct definition of general English oral proficiency tests, although some English-for-academic-purposes (EAP) speaking tests and most writing tests tend to place great emphasis on the evaluation of the content or ideas in the performance. This study investigated the relative contribution of linguistic criteria and the elaboration of speech content to scores on a test of speaking proficiency. A speaking test was designed and administered to Japanese undergraduates to determine what criteria English teachers associate with general oral proficiency. Nine raters were recruited to rate 30 students’ monologues on three topics, using intuitive judgments of oral proficiency (referred to as Overall communicative effectiveness). Following this, they assigned scores to the monologues using five criteria: Grammatical accuracy, Fluency, Vocabulary range, Pronunciation, and Content elaboration/development. The raters were also asked to provide open-ended written comments on the factors contributing to their intuitive judgments. Statistical analyses of the scores – Rasch measurement, multiple regression, and multivariate generalizability (G) theory analysis – revealed that Content elaboration/development made a substantive contribution to the intuitive judgments and composite score. The present study enriches our understanding of general oral proficiency and the construct definition of proficiency tests.
- Subjects
ENGLISH grammar ability testing; ENGLISH language ability testing; VOCABULARY ability testing; FLUENCY (Language learning); PRONUNCIATION; QUANTITATIVE research
- Publication
Language Testing, 2012, Vol 29, Issue 2, p223
- ISSN
0265-5322
- Publication type
Article
- DOI
10.1177/0265532211421162