We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Exploring Contextual Relationships in 3D Cloud Points by Semantic Knowledge Mining.
- Authors
Chen, Lianggangxu; Lu, Jiale; Cai, Yiqing; Wang, Changbo; He, Gaoqi
- Abstract
3D scene graph generation (SGG) aims to predict the class of objects and predicates simultaneously in one 3D point cloud scene with instance segmentation. Since the underlying semantic of 3D point clouds is spatial information, recent ideas of the 3D SGG task usually face difficulties in understanding global contextual semantic relationships and neglect the intrinsic 3D visual structures. To build the global scope of semantic relationships, we first propose two types of Semantic Clue (SC) from entity level and path level, respectively. SC can be extracted from the training set and modeled as the co‐occurrence probability between entities. Then a novel Semantic Clue aware Graph Convolution Network (SC‐GCN) is designed to explicitly model each SC of which the message is passed in their specific neighbor pattern. For constructing the interactions between the 3D visual and semantic modalities, a visual‐language transformer (VLT) module is proposed to jointly learn the correlation between 3D visual features and class label embeddings. Systematic experiments on the 3D semantic scene graph (3DSSG) dataset show that our full method achieves state‐of‐the‐art performance.
- Subjects
POINT cloud; MESSAGE passing (Computer science); POINT set theory
- Publication
Computer Graphics Forum, 2022, Vol 41, Issue 7, p75
- ISSN
0167-7055
- Publication type
Article
- DOI
10.1111/cgf.14658