We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Synthetic Corpus Generation for Deep Learning-Based Translation of Spanish Sign Language.
- Authors
Perea-Trigo, Marina; Botella-López, Celia; Martínez-del-Amor, Miguel Ángel; Álvarez-García, Juan Antonio; Soria-Morillo, Luis Miguel; Vegas-Olmos, Juan José
- Abstract
Sign language serves as the primary mode of communication for the deaf community. With technological advancements, it is crucial to develop systems capable of enhancing communication between deaf and hearing individuals. This paper reviews recent state-of-the-art methods in sign language recognition, translation, and production. Additionally, we introduce a rule-based system, called ruLSE, for generating synthetic datasets in Spanish Sign Language. To check the usefulness of these datasets, we conduct experiments with two state-of-the-art models based on Transformers, MarianMT and Transformer-STMC. In general, we observe that the former achieves better results (+3.7 points in the BLEU-4 metric) although the latter is up to four times faster. Furthermore, the use of pre-trained word embeddings in Spanish enhances results. The rule-based system demonstrates superior performance and efficiency compared to Transformer models in Sign Language Production tasks. Lastly, we contribute to the state of the art by releasing the generated synthetic dataset in Spanish named synLSE.
- Subjects
SIGN language; DEEP learning; SPANISH language; TECHNOLOGICAL innovations; TRANSLATING &; interpreting; NATIVE language
- Publication
Sensors (14248220), 2024, Vol 24, Issue 5, p1472
- ISSN
1424-8220
- Publication type
Article
- DOI
10.3390/s24051472