We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
DexHand: dexterous hand manipulation motion synthesis for virtual reality.
- Authors
Jiang, Haiyan; Weng, Dongdong; Song, Zhen; Dongye, Xiaonuo; Zhang, Zhenliang
- Abstract
Natural object manipulation is one of the important human skills. However, generating natural hand manipulation motions that are adaptive to object shapes and the tasks at hand in virtual reality is still a challenge. In this paper, we propose a neural network-based finger movement generation approach, enabling the generation of plausible hand motions interacting with objects. Given the object shape and movement features in the wrist coordinate system, the first network Generator infers the hand pose at the current frame that matches the object motion and shape. The second network Optimizer then fine-tunes the pose to improve the plausibility of hand-object interaction. Notably, a differentiable optimization module is proposed to generate the training dataset for Optimizer. Experimental results show that our approach can generate plausible dexterous hand manipulation motions for hand-object interaction without obvious delay.
- Subjects
VIRTUAL reality; OBJECT manipulation; POSE estimation (Computer vision); DEEP learning
- Publication
Virtual Reality, 2023, Vol 27, Issue 3, p2341
- ISSN
1359-4338
- Publication type
Article
- DOI
10.1007/s10055-023-00810-2