paper-with-me

홈 › Papers

Towards Real-World Category-level Articulation Pose Estimation

2021-05-07 · Liu Liu, Han Xue, Wenqiang Xu, Haoyuan Fu, Cewu Lu

Human life is populated with articulated objects. Current Category-level Articulation Pose Estimation (CAPE) methods are studied under the single-instance setting with a fixed kinematic structure for each category. Considering these limitations, we reform this problem setting for real-world environments and suggest a CAPE-Real (CAPER) task setting. This setting allows varied kinematic structures within a semantic category, and multiple instances to co-exist in an observation of real world. To support this task, we build an articulated model repository ReArt-48 and present an efficient dataset generation pipeline, which contains Fast Articulated Object Modeling (FAOM) and Semi-Authentic MixEd Reality Technique (SAMERT). Accompanying the pipeline, we build a large-scale mixed reality dataset ReArtMix and a real world dataset ReArtVal. We also propose an effective framework ReArtNOCS that exploits RGB-D input to estimate part-level pose for multiple instances in a single forward pass. Extensive experiments demonstrate that the proposed ReArtNOCS can achieve good performance on both CAPER and CAPE settings. We believe it could serve as a strong baseline for future research on the CAPER task.

📄 PDF Abstract BibTeX arXiv:2105.03260

Code (0)

등록된 구현이 없습니다.

Tasks

Dataset GenerationMixed RealityPose Estimation

Similar Papers 제목 키워드 기반

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting

2025-06-04 · Shengjie Lin, Jiading Fang, Muhammad Zubair Irshad, Vitor Campagnolo Guizilini 외

Reconstructing articulated objects prevalent in daily environments is crucial for applications in augmented/virtual reality and robotics. However, existing methods face scalability limitations (requiring 3D supervision o…

3DGS

Ditto: Building Digital Twins of Articulated Objects from Interaction

2022-02-16 · CVPR 2022 1 · Zhenyu Jiang, Cheng-Chun Hsu, Yuke Zhu

Digitizing physical objects into the virtual world has the potential to unlock new research and applications in embodied AI and mixed reality. This work focuses on recreating interactive digital twins of real-world artic…

3D geometryMixed RealityObject

SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation

2026-06-01 · Can Zhang, Gim Hee Lee arxiv

Existing methods for category-level object articulation from a single 3D observation often rely on dense supervision, multi-frame inputs, or CAD templates, and still struggle to disentangle geometry from articulation or …

Pose Estimation

StrobeNet: Category-Level Multiview Reconstruction of Articulated Objects

2021-05-17 · Ge Zhang, Or Litany, Srinath Sridhar, Leonidas Guibas

We present StrobeNet, a method for category-level 3D reconstruction of articulating objects from one or more unposed RGB images. Reconstructing general articulating object categories % has important applications, but is …

3D ReconstructionObject

AKB-48: A Real-World Articulated Object Knowledge Base

2022-02-17 · CVPR 2022 1 · Liu Liu, Wenqiang Xu, Haoyuan Fu, Sucheng Qian 외

Human life is populated with articulated objects. A comprehensive understanding of articulated objects, namely appearance, structure, physics property, and semantics, will benefit many research communities. As current ar…

ObjectObject ReconstructionPose Estimation