paper-with-me

홈 › Papers

SpatialSim: Recognizing Spatial Configurations of Objects with Graph Neural Networks

2020-04-09 · Laetitia Teodorescu, Katja Hofmann, Pierre-Yves Oudeyer

Recognizing precise geometrical configurations of groups of objects is a key capability of human spatial cognition, yet little studied in the deep learning literature so far. In particular, a fundamental problem is how a machine can learn and compare classes of geometric spatial configurations that are invariant to the point of view of an external observer. In this paper we make two key contributions. First, we propose SpatialSim (Spatial Similarity), a novel geometrical reasoning benchmark, and argue that progress on this benchmark would pave the way towards a general solution to address this challenge in the real world. This benchmark is composed of two tasks: Identification and Comparison, each one instantiated in increasing levels of difficulty. Secondly, we study how relational inductive biases exhibited by fully-connected message-passing Graph Neural Networks (MPGNNs) are useful to solve those tasks, and show their advantages over less relational baselines such as Deep Sets and unstructured models such as Multi-Layer Perceptrons. Finally, we highlight the current limits of GNNs in these tasks.

📄 PDF Abstract BibTeX arXiv:2004.04546

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Deep Sets 설명 없음

Similar Papers 제목 키워드 기반

spatialSim: multi-species spatiotemporal size-structured operating model for management strategy evaluation

2021-09-06 · Christopher D. Nottingham, Russell B. Millar

Spatiotemporal processes have the potential to be one of the most influential factors governing how fisheries targeting sedentary species respond to harvesting. Despite this, management strategy evaluation often fails to…

Management

VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions

2020-03-11 · CVPR 2020 6 · Oytun Ulutan, A. S. M. Iftekhar, B. S. Manjunath

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HO…

Human-Object Interaction DetectionObjectSpatial Reasoning

Closing the Loop: Graph Networks to Unify Semantic Objects and Visual Features for Multi-object Scenes

2022-09-24 · Jonathan J. Y. Kim, Martin Urschler, Patricia J. Riddle, Jörg S. Wicker

In Simultaneous Localization and Mapping (SLAM), Loop Closure Detection (LCD) is essential to minimize drift when recognizing previously visited places. Visual Bag-of-Words (vBoW) has been an LCD algorithm of choice for …

Graph MatchingLoop Closure DetectionSimultaneous Localization and Mapping

Efficient and Interpretable Robot Manipulation with Graph Neural Networks

2021-02-25 · Yixin Lin, Austin S. Wang, Eric Undersander, Akshara Rai

Manipulation tasks, like loading a dishwasher, can be seen as a sequence of spatial constraints and relationships between different objects. We aim to discover these rules from demonstrations by posing manipulation as a …

Decision MakingGraph Neural NetworkImitation LearningRobot Manipulation

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

2014-08-23 · Sanja Fidler, Marko Boben, Ales Leonardis

Hierarchies allow feature sharing between objects at multiple levels of representation, can code exponential variability in a very compact way and enable fast inference. This makes them potentially suitable for learning …

Object