Multi-level Reasoning for Robotic Assembly: From Sequence Inference to Contact Selection

2023-12-17 · Xinghao Zhu, Devesh K. Jha, Diego Romeres, Lingfeng Sun, Masayoshi Tomizuka, Anoop Cherian

Automating the assembly of objects from their parts is a complex problem with innumerable applications in manufacturing, maintenance, and recycling. Unlike existing research, which is limited to target segmentation, pose regression, or using fixed target blueprints, our work presents a holistic multi-level framework for part assembly planning consisting of part assembly sequence inference, part motion planning, and robot contact optimization. We present the Part Assembly Sequence Transformer (PAST) -- a sequence-to-sequence neural network -- to infer assembly sequences recursively from a target blueprint. We then use a motion planner and optimization to generate part movements and contacts. To train PAST, we introduce D4PAS: a large-scale Dataset for Part Assembly Sequences (D4PAS) consisting of physically valid sequences for industrial objects. Experimental results show that our approach generalizes better than prior methods while needing significantly less computational time for inference.

📄 PDF Abstract BibTeX arXiv:2312.10571

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Planningvalid

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Position-Wise Feed-Forward Layer 설명 없음

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Adam 설명 없음

AssemLM: A Spatial Reasoning Multimodal Large Language Model for Robotic Assembly

2026-04-10 · Zhi Jing, Jinbin Qiao, Ouyang Lu, Jicong Ao 외 arxiv

Spatial reasoning is a fundamental capability for embodied intelligence, especially for fine-grained manipulation tasks such as robotic assembly. Recent methods based on vision-language models (VLMs) largely rely on coar…

Spatial Reasoning Point Clouds

CAD-Based Relation Learning and Geometric-Symbolic Planning for Robotic Assembly

2026-09-15 · Fabian Harlacher, Christian Friedrich arxiv

Assembly Sequence Planning (ASP) remains a challenging problem due to its combinatorial nature, making exhaustive planning approaches impractical for complex industrial assemblies. Furthermore, many CAD models lack relia…

Relation Extraction Point Clouds

WorkBenchMark: A LEGO-Based Assembly Benchmark with an Assembly-by-Disassembly Baseline for the Smart Manufacturing League

2026-06-02 · Wenbo Ma, Daniel Swoboda, Matteo Tschesche, Till Hofmann arxiv

We introduceWorkBenchMark, a LEGO Duplo-based robotic assembly benchmark motivated by the RoboCup Smart Manufacturing League. Robotic assembly couples low-level manipulation with task-level symbolic reasoning under physi…

Revolutionizing Battery Disassembly: The Design and Implementation of a Battery Disassembly Autonomous Mobile Manipulator Robot(BEAM-1)

2024-07-09 · Yanlong Peng, Zhigang Wang, Yisheng Zhang, Shengmin Zhang 외

The efficient disassembly of end-of-life electric vehicle batteries(EOL-EVBs) is crucial for green manufacturing and sustainable development. The current pre-programmed disassembly conducted by the Autonomous Mobile Mani…

Efficient and Feasible Robotic Assembly Sequence Planning via Graph Representation Learning

2023-03-17 · Matan Atad, Jianxiang Feng, Ismael Rodríguez, Maximilian Durner 외

Automatic Robotic Assembly Sequence Planning (RASP) can significantly improve productivity and resilience in modern manufacturing along with the growing need for greater product customization. One of the main challenges …

Graph Representation Learning Representation Learning