paper-with-me

홈 › Papers

LEGO-Net: Learning Regular Rearrangements of Objects in Rooms

2023-01-23 · CVPR 2023 1 · Qiuhong Anna Wei, Sijie Ding, Jeong Joon Park, Rahul Sajnani, Adrien Poulenard, Srinath Sridhar, Leonidas Guibas

Humans universally dislike the task of cleaning up a messy room. If machines were to help us with this task, they must understand human criteria for regular arrangements, such as several types of symmetry, co-linearity or co-circularity, spacing uniformity in linear or circular patterns, and further inter-object relationships that relate to style and functionality. Previous approaches for this task relied on human input to explicitly specify goal state, or synthesized scenes from scratch -- but such methods do not address the rearrangement of existing messy scenes without providing a goal state. In this paper, we present LEGO-Net, a data-driven transformer-based iterative method for LEarning reGular rearrangement of Objects in messy rooms. LEGO-Net is partly inspired by diffusion models -- it starts with an initial messy state and iteratively ''de-noises'' the position and orientation of objects to a regular state while reducing distance traveled. Given randomly perturbed object positions and orientations in an existing dataset of professionally-arranged scenes, our method is trained to recover a regular re-arrangement. Results demonstrate that our method is able to reliably rearrange room scenes and outperform other methods. We additionally propose a metric for evaluating regularity in room arrangements using number-theoretic machinery.

📄 PDF Abstract BibTeX arXiv:2301.09629

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generating Physically Stable and Buildable LEGO Designs from Text

2025-05-08 · Ava Pun, Kangle Deng, Ruixuan Liu, Deva Ramanan 외

We introduce LegoGPT, the first approach for generating physically stable LEGO brick models from text prompts. To achieve this, we construct a large-scale, physically stable dataset of LEGO designs, along with their asso…

3D GenerationLarge Language ModelText to 3D

A Lightweight and Transferable Design for Robust LEGO Manipulation

2023-09-05 · Ruixuan Liu, Yifan Sun, Changliu Liu

Lego is a well-known platform for prototyping pixelized objects. However, robotic Lego prototyping (i.e., manipulating Lego bricks) is challenging due to the tight connections and accuracy requirements. This paper invest…

Industrial Robots

Planning for Manipulation among Movable Objects: Deciding Which Objects Go Where, in What Order, and How

2023-03-23 · Dhruv Saxena, Maxim Likhachev

We are interested in pick-and-place style robot manipulation tasks in cluttered and confined 3D workspaces among movable objects that may be rearranged by the robot and may slide, tilt, lean or topple. A recently propose…

Robot Manipulationvalid

Image2Lego: Customized LEGO Set Generation from Images

2021-08-19 · Kyle Lennon, Katharina Fransen, Alexander O'Brien, Yumeng Cao 외

Although LEGO sets have entertained generations of children and adults, the challenge of designing customized builds matching the complexity of real-world or imagined scenes remains too great for the average enthusiast. …

Building LEGO Using Deep Generative Models of Graphs

2020-12-21 · Rylee Thompson, Elahe Ghalebi, Terrance DeVries, Graham W. Taylor

Generative models are now used to create a variety of high-quality digital artifacts. Yet their use in designing physical objects has received far less attention. In this paper, we advocate for the construction toy, LEGO…