We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Extracting Wisdom from Experts and Small Crowds: Strategies for Improving Informant-based Measures of Political Concepts.
- Authors
Maestas, Cherie D.; Buttice, Matthew K.; Stone, Walter J.
- Abstract
Social scientists have increasingly turned to expert judgments to generate data for difficult-to-measure concepts, but getting access to and response from highly expert informants can be costly and challenging. We examine how informant selection and post-survey response aggregation influence the validity and reliability of measures built from informant observations. We draw upon three surveys with parallel survey questions of candidate characteristics to examine the trade-off between expanding the size of the local informant pool and the pool’s level of expertise. We find that a “wisdom-of-crowds” effect trumps the benefits associated with the expertise of individual informants when the size of the rater pool is modestly increased. We demonstrate that the benefits of expertise are best realized by prescreening potential informants for expertise rather than post-survey weighting by expertise.
- Subjects
SOCIAL scientists; JUDGMENT (Psychology); INFORMANT reliability; SOCIAL surveys; EXPERTISE
- Publication
Political Analysis, 2014, Vol 22, Issue 3, p354
- ISSN
1047-1987
- Publication type
Article
- DOI
10.1093/pan/mpt050