We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Facial Emotion Recognition from an Unmanned Flying Social Robot for Home Care of Dependent People.
- Authors
Martínez, Anselmo; Belmonte, Lidia M.; García, Arturo S.; Fernández-Caballero, Antonio; Morales, Rafael; Malfaz, María; Castillo, José Carlos; Castro, Álvaro; Alonso, Fernando
- Abstract
This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person's state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the message queue telemetry transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) system developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person's face in the image captured by the UAV's on-board camera and classify the emotion among seven possible ones (surprise; fear; happiness; sadness; disgust; anger; or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.
- Subjects
EMOTION recognition; SOCIAL robots; AVATARS (Virtual reality); HUMAN-robot interaction; COMPUTER vision; EMOTIONS; CONVOLUTIONAL neural networks
- Publication
Electronics (2079-9292), 2021, Vol 10, Issue 7, p868
- ISSN
2079-9292
- Publication type
Article
- DOI
10.3390/electronics10070868