We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Object-agnostic Affordance Categorization via Unsupervised Learning of Graph Embeddings.
- Authors
Toumpa, Alexia; Cohn, Anthony G.
- Abstract
Acquiring knowledge about object interactions and affordances can facilitate scene understanding and human-robot collaboration tasks. As humans tend to use objects in many different ways depending on the scene and the objects' availability, learning object affordances in everyday-life scenarios is a challenging task, particularly in the presence of an open set of interactions and objects. We address the problem of affordance categorization for class-agnostic objects with an open set of interactions; we achieve this by learning similarities between object interactions in an unsupervised way and thus inducing clusters of object affordances. A novel depth-informed qualitative spatial representation is proposed for the construction of Activity Graphs (AGs), which abstract from the continuous representation of spatio-temporal interactions in RGB-D videos. These AGs are clustered to obtain groups of objects with similar affordances. Our experiments in a real-world scenario demonstrate that our method learns to create object affordance clusters with a high V-measure even in cluttered scenes. The proposed approach handles object occlusions by capturing effectively possible interactions and without imposing any object or scene constraints.
- Subjects
HUMAN-robot interaction; TASK performance; DATA acquisition systems; ARTIFICIAL intelligence; CONFIGURATION management
- Publication
Journal of Artificial Intelligence Research, 2023, Vol 77, p1
- ISSN
1076-9757
- Publication type
Article
- DOI
10.1613/jair.1.13253