We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Gesture-Based Emotion Recognition by 3D-CNN and LSTM with Keyframes Selection.
- Authors
Son Thai Ly; Guee-Sang Lee; Soo-Hyung Kim; Hyung-Jeong Yang
- Abstract
In recent years, emotion recognition has been an interesting and challenging topic. Compared to facial expressions and speech modality, gesture-based emotion recognition has not received much attention with only a few efforts using traditional hand-crafted methods. These approaches require major computational costs and do not offer many opportunities for improvement as most of the science community is conducting their research based on the deep learning technique. In this paper, we propose an end-to-end deep learning approach for classifying emotions based on bodily gestures. In particular, the informative keyframes are first extracted from raw videos as input for the 3D-CNN deep network. The 3D-CNN exploits the short-term spatiotemporal information of gesture features from selected keyframes, and the convolutional LSTM networks learn the long-term feature from the features results of 3D-CNN. The experimental results on the FABO dataset exceed most of the traditional methods results and achieve state-of-the-art results for the deep learning-based technique for gesture-based emotion recognition.
- Subjects
EMOTION recognition; GESTURE; FACIAL expression; DEEP learning
- Publication
International Journal of Contents, 2019, Vol 15, Issue 4, p59
- ISSN
1738-6764
- Publication type
Article
- DOI
10.5392/IJoC.2019.15.4.059