My House, My Rules: Learning Tidying Preferences with Graph Neural Networks
Robots that arrange household objects should do so according to the user's preferences, which are inherently subjective and difficult to model. We present NeatNet: a novel Variational Autoencoder architecture using Graph Neural Network layers, which can extract a low-dimensional latent preference vector from a user by observing how they arrange scenes. Given any set of objects, this vector can then be used to generate an arrangement which is tailored to that user's spatial preferences, with word embeddings used for generalisation to new objects. We develop a tidying simulator to gather rearrangement examples from 75 users, and demonstrate empirically that our method consistently produces neat and personalised arrangements across a variety of rearrangement scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RoboTidy : A 3D Gaussian Splatting Household Tidying Benchmark for Embodied Navigation and Action
Household tidying is an important application area, yet current benchmarks neither model user preferences nor support mobility, and they generalize poorly, making it hard to comprehensively assess integrated language-to-…
Housekeep: Tidying Virtual Households using Commonsense Reasoning
We introduce Housekeep, a benchmark to evaluate commonsense reasoning in the home for embodied AI. In Housekeep, an embodied agent must tidy a house by rearranging misplaced objects without explicit instructions specifyi…
Language ModelingLanguage ModellingLarge Language ModelWorld Robot Challenge 2020 -- Partner Robot: A Data-Driven Approach for Room Tidying with Mobile Manipulator
Tidying up a household environment using a mobile manipulator poses various challenges in robotics, such as adaptation to large real-world environmental variations, and safe and robust deployment in the presence of human…
Motion PlanningTANK meets Diaz-Alejandro: Household heterogeneity, non-homothetic preferences & policy design
This paper studies the role of households' heterogeneity in access to financial markets and the consumption of commodity goods in the transmission of foreign shocks. First, I use survey data from Uruguay to show that low…
TIDEE: Tidying Up Novel Rooms using Visuo-Semantic Commonsense Priors
We introduce TIDEE, an embodied agent that tidies up a disordered scene based on learned commonsense object placement and room arrangement priors. TIDEE explores a home environment, detects objects that are out of their …
Object