We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Real-time Informatized caption enhancement based on speaker pronunciation time database.
- Authors
Choi, Yong-Sik; Kang, Jin-Gu; Joo, Jong Wha J.; Jung, Jin-Woo
- Abstract
IBM Watson is one of the representative tools for speech recognition system which can automatically generate not only speech-to-text information but also speaker ID and timing information, which is called as Informatized Caption. However, if there is some noise in the voice signal to the IBM Watson API, the recognition performance is significantly decreased. It can be easily found in movies with background music and special sound effects. This paper aims to improve the inaccuracy problem of current Informatized Captions in noisy environments. In this paper, a method of modifying incorrectly recognized words and a method of enhancing timing accuracy while updating database in real time are suggested based on the original caption and Informatized Caption information. Experimental results shows that the proposed method can give 81.09% timing accuracy for the case of 10 representative animation, horror and action movies.
- Subjects
AUTOMATIC speech recognition; ACTION &; adventure films; PRONUNCIATION; MOTION picture music; ENVIRONMENTAL music; SOUNDS
- Publication
Multimedia Tools & Applications, 2020, Vol 79, Issue 47/48, p35667
- ISSN
1380-7501
- Publication type
Article
- DOI
10.1007/s11042-020-09590-2