3D Landmark Detection on Human Point Clouds: A Benchmark and A Dual Cascade Point Transformer Framework
3D landmark detection plays a pivotal role in various applications such as 3D registration, pose estimation, and virtual try-on. While considerable success has been achieved in 2D human landmark detection or pose estimation, there is a notable scarcity of reported works on landmark detection in unordered 3D point clouds. This paper introduces a novel challenge, namely 3D landmark detection on human point clouds, presenting two primary contributions. Firstly, we establish a comprehensive human point cloud dataset, named HPoint103, designed to support the 3D landmark detection community. This dataset comprises 103 human point clouds created with commercial software and actors, each manually annotated with 11 stable landmarks. Secondly, we propose a Dual Cascade Point Transformer (D-CPT) model for precise point-based landmark detection. D-CPT gradually refines the landmarks through cascade Transformer decoder layers across the entire point cloud stream, simultaneously enhancing landmark coordinates with a RefineNet over local regions. Comparative evaluations with popular point-based methods on HPoint103 and the public dataset DHP19 demonstrate the dramatic outperformance of our D-CPT. Additionally, the integration of our RefineNet into existing methods consistently improves performance.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderPose EstimationVirtual Try-onMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LmPT: Conditional Point Transformer for Anatomical Landmark Detection on 3D Point Clouds
Accurate identification of anatomical landmarks is crucial for various medical applications. Traditional manual landmarking is time-consuming and prone to inter-observer variability, while rule-based methods are often ta…
Point CloudsOccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility
Accurate facial landmark detection under occlusion remains challenging, especially for human-like faces with large appearance variation and rotation-driven self-occlusion. Existing detectors typically localize landmarks …
Facial Landmark DetectionCombining Deep Learning and Model-Based Methods for Robust Real-Time Semantic Landmark Detection
Compared to abstract features, significant objects, so-called landmarks, are a more natural means for vehicle localization and navigation, especially in challenging unstructured environments. The major challenge is to re…
3D landmark detection for augmented reality based otologic procedures
Ear consists of the smallest bones in the human body and does not contain significant amount of distinct landmark points that may be used to register a preoperative CT-scan with the surgical video in an augmented reality…
Interpretable Affordance Detection on 3D Point Clouds with Probabilistic Prototypes
Robotic agents need to understand how to interact with objects in their environment, both autonomously and during human-robot interactions. Affordance detection on 3D point clouds, which identifies object regions that al…
Affordance DetectionDecision Making