We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Does understanding what a test measures make a difference? On the relevance of the ability to identify criteria for situational judgment test performance.
- Authors
Reznik, Nomi; Krumm, Stefan; Freudenstein, Jan‐Philipp; Heimann, Anna L.; Ingold, Pia; Schäpers, Philipp; Kleinmann, Martin
- Abstract
Situational judgment tests (SJTs) are low‐fidelity simulations that are often used in personnel selection. Previous research has provided evidence that the ability to identify criteria (ATIC)—individuals' capability to detect underlying constructs in nontransparent personnel selection procedures—is relevant in simulations in personnel selection, such as assessment centers and situational interviews. Building on recent theorizing about response processes in SJTs as well as on previous empirical results, we posit that ATIC predicts SJT performance. We tested this hypothesis across two preregistered studies. In Study 1, a between‐subjects planned‐missingness design (N = 391 panelists) was employed and 55 selected items from five different SJTs were administered. Mixed‐effects‐modeling revealed a small effect for ATIC in predicting SJT responses. Results were replicated in Study 2 (N = 491 panelists), in which a complete teamwork SJT was administered with a high‐ or a low‐stakes instruction and showed either no or a small correlation with ATIC, respectively. We compare these findings with other studies, discuss implications for our understanding of response processes in SJTs, and derive avenues for future research. Practitioner points: Not much is known about the relevance of ATIC for situational judgment tests (SJTs).Two studies revealed a small or no effect for ATIC in predicting SJT responses.ATIC variance might be explained more by constructs that items tap into than by individuals.
- Subjects
JUDGMENT (Psychology); EMPLOYEE selection
- Publication
International Journal of Selection & Assessment, 2024, Vol 32, Issue 2, p210
- ISSN
0965-075X
- Publication type
Article
- DOI
10.1111/ijsa.12458