RGL-NET: A Recurrent Graph Learning framework for Progressive Part Assembly
Autonomous assembly of objects is an essential task in robotics and 3D computer vision. It has been studied extensively in robotics as a problem of motion planning, actuator control and obstacle avoidance. However, the task of developing a generalized framework for assembly robust to structural variants remains relatively unexplored. In this work, we tackle this problem using a recurrent graph learning framework considering inter-part relations and the progressive update of the part pose. Our network can learn more plausible predictions of shape structure by accounting for priorly assembled parts. Compared to the current state-of-the-art, our network yields up to 10% improvement in part accuracy and up to 15% improvement in connectivity accuracy on the PartNet dataset. Moreover, our resulting latent space facilitates exciting applications such as shape recovery from the point-cloud components. We conduct extensive experiments to justify our design choices and demonstrate the effectiveness of the proposed framework.
Code (1)
Tasks
Graph LearningMotion PlanningSimilar Papers 제목 키워드 기반
PVRA: A Pointwise Key-point Voting Framework for Robotic Assembly
Modern computer vision has enabled partial autonomy in robotic assembly manipulation. However, performing autonomous manipulation of a progressive assembly demands a more specific set of skills, in addition to perceiving…
Pose EstimationShape of Thought: Progressive Object Assembly via Visual Chain-of-Thought
Multimodal models for text-to-image generation have achieved strong visual fidelity, yet they remain brittle under compositional structural constraints, notably generative numeracy, attribute binding, and part-level rela…
Text-to-Image GenerationGenerative 3D Part Assembly via Dynamic Graph Learning
Autonomous part assembly is a challenging yet crucial task in 3D computer vision and robotics. Analogous to buying an IKEA furniture, given a set of 3D parts that can assemble a single shape, an intelligent agent needs t…
Graph LearningGraph Neural NetworkPose EstimationRelational ReasoningGBOT: Graph-Based 3D Object Tracking for Augmented Reality-Assisted Assembly Guidance
Guidance for assemblable parts is a promising field for augmented reality. Augmented reality assembly guidance requires 6D object poses of target objects in real time. Especially in time-critical medical or industrial se…
3D Object Tracking6D Pose EstimationMulti-Object TrackingObject+2Linkify: Learning from Interface-Augmented Assembly Graphs
We present Linkify, a framework for learning from interface-augmented assembly graphs to enable context-aware part retrieval in mechanical assemblies. While recent generative AI methods for CAD have focused largely on is…