We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Revolutionising Educational Assessment: Automated Question Classification using Bloom's Taxonomy and Deep Learning Techniques -- A Case Study on Undergraduate Examination Questions.
- Authors
Banujan, Kuhaneswaran; Kumara, Samantha; Prasanth, Senthan; Ravikumar, Nirubikaa
- Abstract
Examinations are one way of evaluating students. To ensure the production of valid exams, frameworks such as Bloom's taxonomy are utilised when preparing questions. Bloom's taxonomy is a well-known framework that categorises educational objectives into six hierarchical levels of cognitive complexity. However, manually categorising exam questions can be time-consuming and subjective. The extant literature has yet to leverage advanced deep learning methods and state-of-the-art word embedding techniques. This study utilises the effectiveness of Artificial Neural Network (ANN) and Long Short-Term Memory (LSTM) models along with GloVe, BERT and TF-IDF for automating the classification of exam questions according to the revised Bloom's taxonomy. The study collected various question types from online sources and multiple state universities in Sri Lanka, resulting in a dataset of 16,584 questions labelled manually with the aid of domain experts. The dataset was cleaned using natural language processing techniques. Three models were proposed: ANN+TF-IDF, LSTM+GloVe, and LSTM+BERT. The results of the ANOVA and post hoc pairwise comparisons using Bonferroni correction indicate that the LSTM+BERT model outperformed the other models significantly. The proposed approach provides a reliable and consistent way of evaluating students, and educators can use it to improve their teaching strategies. The findings of this study have important implications for educational institutions and can lead to more effective and efficient evaluations.
- Subjects
SRI Lanka; BLOOM'S taxonomy; DEEP learning; EDUCATIONAL evaluation; NATURAL language processing; BONFERRONI correction; EDUCATIONAL objectives
- Publication
International Journal of Education & Development using Information & Communication Technology, 2023, Vol 19, Issue 3, p259
- ISSN
1814-0556
- Publication type
Article