We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Design and development of a vision‐based system for detection, tracking and recognition of isolated dynamic bare hand gesticulated characters.
- Authors
Yadav, Kuldeep Singh; Kirupakaran, Anish Monsley; Laskar, Rabul Hussain; Bhuyan, Manas Kamal; Khan, Taimoor
- Abstract
Detection and tracking are the vital stages to form the gesture trajectory in gesture recognition. It becomes more challenging when the variations in illumination, pose, position, occlusion, scale, speed, blurring effect and complex environment are introduced. Additionally, the background feature domination effect affects the existing deep learning models. A semantic segmentation model is implemented in this work to detect the bare hand to overcome these challenges. A pre‐trained network VGG‐16 is utilized by training with the proposed NITS S‐Net database. Evaluation of the SegNet model is done on EgoHands, Oxford and OUHands databases. To track the bare hand, a SegNet‐based detection and tracking approach is proposed using Kalman filter and point‐tracker. This model achieves 97.01% accuracy (a relative improvement of ~8% from the baseline models) at 0.068 s per frame computational time on NITS hand gesture database VIIIB. The gesticulated characters, that is, alphabets, numbers, operators, special characters, are gesticulated without any constraints on the pattern/strokes. To recognize these 95 multi‐stroke gestures, a deep convolutional neural network (DCNN) is presented using AlexNet. The DCNN model achieves 97.60% (a relative improvement of ~14% from the baseline models) accuracy on the NITS hand gesture database VIIIB merged. Evaluation of the handwritten EMNIST merged (balanced) database resulted in average recognition accuracy of 91.60%.
- Subjects
ARTIFICIAL neural networks; CONVOLUTIONAL neural networks; SYSTEMS development; DEEP learning; KALMAN filtering
- Publication
Expert Systems, 2022, Vol 39, Issue 7, p1
- ISSN
0266-4720
- Publication type
Article
- DOI
10.1111/exsy.12970