We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Internet-Based, Unproctored Assessments on Mobile and Non-Mobile Devices: Usage, Measurement Equivalence, and Outcomes.
- Authors
Illingworth, A.; Morelli, Neil; Scott, John; Boyd, Scott
- Abstract
Purpose: The purpose of this study was to determine the usage rates, measurement equivalence, and potential outcome differences between mobile and non-mobile device-based deliveries of an unproctored, non-cognitive assessment. Design/Methodology/Approach: This study utilized a quasi-experimental design based on archival data obtained from applicants who completed a non-cognitive assessment on a mobile ( n = 7,743; e.g., smartphones, tablet computers) or non-mobile ( n = 929,341; e.g., desktop computers) device as part of an operational, high-stakes pre-employment selection process. Findings: One percent of applicants used mobile devices to complete the assessment. Multiple-group confirmatory factor analysis indicated the assessment was equivalent across mobile and non-mobile devices at the configural, metric, scalar, and latent mean levels. A comparison of observed score means using one-way and factorial ANOVAs demonstrated that the use of mobile and non-mobile devices did not produce any practically significant score differences on the assessment across devices or applicant demographic subgroups. Implications: Industry and technological trends suggest mobile device usage will only increase. Thus, demonstrating that mobile device functionality and hardware characteristics do not change the psychometric functioning or applicant outcomes for a non-cognitive, text-based selection assessment is critical to talent assessment. Originality/Value: This study provides the first empirical examination of the usage of mobile devices to complete talent assessments and their impact on assessment properties and applicant outcomes, and serves as the foundation for future research and application of this growing technological trend in pre-employment assessment.
- Subjects
INFORMATION technology; CLOUD computing; EVALUATION research; CONFIRMATORY factor analysis; PSYCHOMETRICS
- Publication
Journal of Business & Psychology, 2015, Vol 30, Issue 2, p325
- ISSN
0889-3268
- Publication type
Article
- DOI
10.1007/s10869-014-9363-8