paper-with-me

홈 › Papers

NAP: Neural 3D Articulation Prior

2023-05-25 · Jiahui Lei, Congyue Deng, Bokui Shen, Leonidas Guibas, Kostas Daniilidis

We propose Neural 3D Articulation Prior (NAP), the first 3D deep generative model to synthesize 3D articulated object models. Despite the extensive research on generating 3D objects, compositions, or scenes, there remains a lack of focus on capturing the distribution of articulated objects, a common object category for human and robot interaction. To generate articulated objects, we first design a novel articulation tree/graph parameterization and then apply a diffusion-denoising probabilistic model over this representation where articulated objects can be generated via denoising from random complete graphs. In order to capture both the geometry and the motion structure whose distribution will affect each other, we design a graph-attention denoising network for learning the reverse diffusion process. We propose a novel distance that adapts widely used 3D generation metrics to our novel task to evaluate generation quality, and experiments demonstrate our high performance in articulated object generation. We also demonstrate several conditioned generation applications, including Part2Motion, PartNet-Imagination, Motion2Part, and GAPart2Object.

📄 PDF Abstract BibTeX arXiv:2305.16315

Code (1)

chenguolin/InstructScene pytorch

Tasks

3D GenerationDenoisingGraph AttentionObject

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory

2020-08-24 · Ajinkya Jain, Rudolf Lioutikov, Caleb Chuck, Scott Niekum

Robots in human environments will need to interact with a wide variety of articulated objects such as cabinets, drawers, and dishwashers while assisting humans in performing day-to-day tasks. Existing methods either requ…

Benchmarking

Towards a Quantitative Analysis of Coarticulation with a Phoneme-to-Articulatory Model

2024-08-10 · Chaofei Fan, Jaimie M. Henderson, Chris Manning, Francis R. Willett

Prior coarticulation studies focus mainly on limited phonemic sequences and specific articulators, providing only approximate descriptions of the temporal extent and magnitude of coarticulation. This paper is an initial …

Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement

2026-03-03 · Hao Ai, Wenjie Chang, Jianbo Jiao, Ales Leonardis 외 arxiv

Articulated objects are ubiquitous in daily life. Our goal is to achieve a high-quality reconstruction, segmentation of independent moving parts, and analysis of articulation. Recent methods analyse two different articul…

UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image

2026-06-29 · Mohamed el Amine Boudjoghra, Ivan Laptev, Angela Dai arxiv

Articulated 3D objects are essential for interactive environments in embodied AI, robotics, and virtual reality, but reconstructing their structure and motion from sparse observations remains challenging. Existing approa…

3D Object Reconstruction

Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects

2024-04-01 · CVPR 2024 1 · Yijia Weng, Bowen Wen, Jonathan Tremblay, Valts Blukis 외

We address the problem of building digital twins of unknown articulated objects from two RGBD scans of the object at different articulation states. We decompose the problem into two stages, each addressing distinct aspec…

Articulated Object modelling