We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Can intelligent agents improve data quality in online questiosnnaires? A pilot study.
- Authors
Söderström, Arne; Shatte, Adrian; Fuller-Tyszkiewicz, Matthew
- Abstract
We explored the utility of chatbots for improving data quality arising from collection via sonline surveys. Three-hundred Australian adults sampled via Prolific Academic were randomized across chatbot-supported or unassisted online questionnaire conditions. The questionnaire comprised validated measures, along with challenge items formulated to be confusing yet aligned with the validated targets. The chatbot condition provided optional assistance with item clarity via a virtual support agent. Chatbot use and user satisfaction were measured through session logs and user feedback. Data quality was operationalized as between-group differences in relationships among validated and challenge measures. Findings broadly supported chatbot utility for online surveys, showing that most participants with chatbot access utilized it, found it helpful, and demonstrated modestly improved data quality (vs. controls). Absence of confusion for one challenge item is believed to have contributed to an underestimated effect. Findings show that assistive chatbots can enhance data quality, will be utilized by many participants if available, and are perceived as beneficial by most users. Scope constraints for this pilot study are believed to have led to underestimated effects. Future testing with longer-form questionnaires incorporating expanded item difficulty may further understanding of chatbot utility for survey completion and data quality.
- Subjects
DATA quality; INTELLIGENT agents; PILOT projects; QUESTIONNAIRES; CHATBOTS
- Publication
Behavior Research Methods, 2021, Vol 53, Issue 5, p2238
- ISSN
1554-351X
- Publication type
Article
- DOI
10.3758/s13428-021-01574-w