We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
3D CNN HAND POSE ESTIMATION WITH END-TO-END HIERARCHICAL MODEL AND PHYSICAL CONSTRAINTS FROM DEPTH IMAGES.
- Authors
Xu, Z. Z.; Zhang, W. J.
- Abstract
Previous studies are mainly focused on the works that depth image is treated as flat image, and then depth data tends to be mapped as gray values during the convolution processing and features extraction. To address this issue, an approach of 3D CNN hand pose estimation with end-to-end hierarchical model and physical constraints is proposed. After reconstruction of 3D space structure of hand from depth image, 3D model is converted into voxel grid for further hand pose estimation by 3D CNN. The 3D CNN method makes improvements by embedding end-to-end hierarchical model and constraints algorithm into the networks, resulting to train at fast convergence rate and avoid unrealistic hand pose. According to the experimental results, it reaches 87.98% of mean accuracy and 8.82mm of mean absolute error (MAE) for all 21 joints within 24 ms at the inference time, which consistently outperforms several well-known gesture recognition algorithms.
- Subjects
POSE estimation (Computer vision); CONSTRAINT algorithms; LARGE space structures (Astronautics); FEATURE extraction; GESTURE
- Publication
Neural Network World, 2023, Issue 1, p35
- ISSN
1210-0552
- Publication type
Article
- DOI
10.14311/NNW.2023.33.003