We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Deep neural network-based fusion model for emotion recognition using visual data.
- Authors
Do, Luu-Ngoc; Yang, Hyung-Jeong; Nguyen, Hai-Duong; Kim, Soo-Hyung; Lee, Guee-Sang; Na, In-Seop
- Abstract
In this study, we present a fusion model for emotion recognition based on visual data. The proposed model uses video information as its input and generates emotion labels for each video sample. Based on the video data, we first choose the most significant face regions with the use of a face detection and selection step. Subsequently, we employ three CNN-based architectures to extract the high-level features of the face image sequence. Furthermore, we adjusted one additional module for each CNN-based architecture to capture the sequential information of the entire video dataset. The combination of the three CNN-based models in a late-fusion-based approach yields a competitive result when compared to the baseline approach while using two public datasets: AFEW 2016 and SAVEE.
- Subjects
EMOTION recognition; EMOTIONS; AMYGDALOID body; CONVOLUTIONAL neural networks; FACE
- Publication
Journal of Supercomputing, 2021, Vol 77, Issue 10, p10773
- ISSN
0920-8542
- Publication type
Article
- DOI
10.1007/s11227-021-03690-y