paper-with-me

홈 › Papers

Visual Room Rearrangement

2021-03-30 · CVPR 2021 1 · Luca Weihs, Matt Deitke, Aniruddha Kembhavi, Roozbeh Mottaghi

There has been a significant recent progress in the field of Embodied AI with researchers developing models and algorithms enabling embodied agents to navigate and interact within completely unseen environments. In this paper, we propose a new dataset and baseline models for the task of Rearrangement. We particularly focus on the task of Room Rearrangement: an agent begins by exploring a room and recording objects' initial configurations. We then remove the agent and change the poses and states (e.g., open/closed) of some objects in the room. The agent must restore the initial configurations of all objects in the room. Our dataset, named RoomR, includes 6,000 distinct rearrangement settings involving 72 different object types in 120 scenes. Our experiments show that solving this challenging interactive task that involves navigation and object interaction is beyond the capabilities of the current state-of-the-art techniques for embodied tasks and we are still very far from achieving perfect performance on these types of tasks. The code and the dataset are available at: https://ai2thor.allenai.org/rearrangement

📄 PDF Abstract BibTeX arXiv:2103.16544

Code (2)

allenai/robothor-challenge 공식 구현
allenai/ai2thor-rearrangement pytorch

Tasks

Navigate

Similar Papers 제목 키워드 기반

A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Search

2022-06-21 · Brandon Trabucco, Gunnar Sigurdsson, Robinson Piramuthu, Gaurav S. Sukhatme 외

Physically rearranging objects is an important capability for embodied agents. Visual room rearrangement evaluates an agent's ability to rearrange objects in a room to a desired goal based solely on visual input. We prop…

Semantic Segmentation

A Category Agnostic Model for Visual Rearrangment

2024-01-01 · CVPR 2024 1 · Yuyi Liu, Xinhang Song, Weijie Li, Xiaohan Wang 외

This paper presents a novel category agnostic model for visual rearrangement task which can help an embodied agent to physically recover the shuffled scene configuration without any category concepts to the goal conf…

Change DetectionmodelScene Change Detection

LEGO-Net: Learning Regular Rearrangements of Objects in Rooms

2023-01-23 · CVPR 2023 1 · Qiuhong Anna Wei, Sijie Ding, Jeong Joon Park, Rahul Sajnani 외

Humans universally dislike the task of cleaning up a messy room. If machines were to help us with this task, they must understand human criteria for regular arrangements, such as several types of symmetry, co-linearity o…

TIDEE: Tidying Up Novel Rooms using Visuo-Semantic Commonsense Priors

2022-07-21 · Gabriel Sarch, Zhaoyuan Fang, Adam W. Harley, Paul Schydlo 외

We introduce TIDEE, an embodied agent that tidies up a disordered scene based on learned commonsense object placement and room arrangement priors. TIDEE explores a home environment, detects objects that are out of their …

Object

Hierarchical Object-Oriented POMDP Planning for Object Rearrangement

2024-12-02 · Rajesh Mangannavar, Alan Fern, Prasad Tadepalli

We present an online planning framework for solving multi-object rearrangement problems in partially observable, multi-room environments. Current object rearrangement solutions, primarily based on Reinforcement Learning …

ObjectObject Rearrangement