AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning

2024-10-20 · Alan Chen, Changliu Liu

A critical goal in robotics and autonomy is to teach robots to adapt to real-world collaborative tasks, particularly in automatic assembly. The ability of a robot to understand the original intent of an incomplete assembly and complete missing features without human instruction is valuable but challenging. This paper introduces 3D combinatorial assembly completion, which is demonstrated using combinatorial unit primitives (i.e., Lego bricks). Combinatorial assembly is challenging due to the possible assembly combinations and complex physical constraints (e.g., no brick collisions, structure stability, inventory constraints, etc.). To address these challenges, we propose a two-part deep reinforcement learning (DRL) framework that tackles teaching the robot to understand the objective of an incomplete assembly and learning a construction policy to complete the assembly. The robot queries a stable object library to facilitate assembly inference and guide learning. In addition to the robot policy, an action mask is developed to rule out invalid actions that violate physical constraints for object-oriented construction. We demonstrate the proposed framework's feasibility and robustness in a variety of assembly scenarios in which the robot satisfies real-life assembly with respect to both solution and runtime quality. Furthermore, results demonstrate that the proposed framework effectively infers and assembles incomplete structures for unseen and unique object types.

📄 PDF Abstract BibTeX arXiv:2410.15469

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Library 설명 없음

Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routing

2020-10-22 · NeurIPS 2020 12 · Arthur Delarue, Ross Anderson, Christian Tjandraatmadja

Value-function-based methods have long played an important role in reinforcement learning. However, finding the best next action given a value function of arbitrary complexity is nontrivial when the action space is too l…

Combinatorial Optimization Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning

2021-10-29 · NeurIPS 2021 12 · Hyunsoo Chung, Jungtaek Kim, Boris Knyazev, Jinhwi Lee 외

Discovering a solution in a combinatorial space is prevalent in many real-world problems but it is also challenging due to diverse complex constraints and the vast number of possible combinations. To address such a probl…

Deep Reinforcement Learning Object reinforcement-learning Reinforcement Learning+1

Combinatorial Optimization Augmented Machine Learning

2026-01-15 · Maximilian Schiffer, Heiko Hoppe, Yue Su, Louis Bouvier 외 arxiv

Combinatorial optimization augmented machine learning (COAML) has recently emerged as a powerful paradigm for integrating predictive models with combinatorial decision-making. By embedding combinatorial optimization orac…

Stochastic Optimization Reinforcement Learning

Reinforcement Learning for Sampling on Temporal Medical Imaging Sequences

2023-08-28 · Zhishen Huang

Accelerated magnetic resonance imaging resorts to either Fourier-domain subsampling or better reconstruction algorithms to deal with fewer measurements while still generating medical images of high quality. Determining t…

Image Reconstruction Q-Learning reinforcement-learning Reinforcement Learning+1

Physics-Aware Combinatorial Assembly Sequence Planning using Data-free Action Masking

2024-08-19 · Ruixuan Liu, Alan Chen, WeiYe Zhao, Changliu Liu

Combinatorial assembly uses standardized unit primitives to build objects that satisfy user specifications. This paper studies assembly sequence planning (ASP) for physical combinatorial assembly. Given the shape of the …