We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Generating 3D Faces using Multi‐column Graph Convolutional Networks.
- Authors
Li, Kun; Liu, Jingying; Lai, Yu‐Kun; Yang, Jingyu
- Abstract
In this work, we introduce multi‐column graph convolutional networks (MGCNs), a deep generative model for 3D mesh surfaces that effectively learns a non‐linear facial representation. We perform spectral decomposition of meshes and apply convolutions directly in the frequency domain. Our network architecture involves multiple columns of graph convolutional networks (GCNs), namely large GCN (L‐GCN), medium GCN (M‐GCN) and small GCN (S‐GCN), with different filter sizes to extract features at different scales. L‐GCN is more useful to extract large‐scale features, whereas S‐GCN is effective for extracting subtle and fine‐grained features, and M‐GCN captures information in between. Therefore, to obtain a high‐quality representation, we propose a selective fusion method that adaptively integrates these three kinds of information. Spatially non‐local relationships are also exploited through a self‐attention mechanism to further improve the representation ability in the latent vector space. Through extensive experiments, we demonstrate the superiority of our end‐to‐end framework in improving the accuracy of 3D face reconstruction. Moreover, with the help of variational inference, our model has excellent generating ability.
- Subjects
VECTOR spaces; MATHEMATICAL convolutions; FACE
- Publication
Computer Graphics Forum, 2019, Vol 38, Issue 7, p215
- ISSN
0167-7055
- Publication type
Article
- DOI
10.1111/cgf.13830