We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
EfficientNetV2-based dynamic gesture recognition using transformed scalogram from triaxial acceleration signal.
- Authors
Bumsoo Kim; Sanghyun Seo
- Abstract
In this paper, a dynamic gesture recognition system is proposed using triaxial acceleration signal and image-based deep neural network. With our dexterous glove device, 1D acceleration signal can be measured from each finger and decomposed to time-divided frequency components via wavelet transformation, which is known as scalogram as image-like format. To feed-forward the scalogram with single 2D, convolutional neural networks allows the gesture having temporality to be easily recognized without any complex system such as RNN, LSTM, or spatio-temporal feature as 3D CNN, etc. To classify the image with general input dimension of image RGB channels, we numerically reconstruct fifteen scalograms into one RGB image with various representation methods. In experiments, we employ the off-the-shelf model, EfficientNetV2 small-to-large model as an image classification model with fine-tuning. To evaluate our system, we bulid our custom bicycle hand signals as dynamic gesture dataset under our transformation system, and then qualitatively compare the reconstruction method with matrix representation methods. In addition, we use other signal transformation tools such as the fast Fourier transform and short-time Fourier transform and then explain the advantages of scalogram classification in the terms of time-frequency resolution trade-off issue.
- Subjects
IMAGE recognition (Computer vision); HAND signals; FAST Fourier transforms; GESTURE; CONVOLUTIONAL neural networks; PHYSIOLOGICAL effects of acceleration
- Publication
Journal of Computational Design & Engineering, 2023, Vol 10, Issue 4, p1694
- ISSN
2288-4300
- Publication type
Article
- DOI
10.1093/jcde/qwad068