paper-with-me

Papers

ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild

2022-08-23 · Lumin Xu, Sheng Jin, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo, Xiaogang Wang

This paper investigates the task of 2D whole-body human pose estimation, which aims to localize dense landmarks on the entire human body including body, feet, face, and hands. We propose a single-network approach, termed ZoomNet, to take into account the hierarchical structure of the full human body and solve the scale variation of different body parts. We further propose a neural architecture search framework, termed ZoomNAS, to promote both the accuracy and efficiency of whole-body pose estimation. ZoomNAS jointly searches the model architecture and the connections between different sub-modules, and automatically allocates computational complexity for searched sub-modules. To train and evaluate ZoomNAS, we introduce the first large-scale 2D human whole-body dataset, namely COCO-WholeBody V1.0, which annotates 133 keypoints for in-the-wild images. Extensive experiments demonstrate the effectiveness of ZoomNAS and the significance of COCO-WholeBody V1.0.

📄 PDF Abstract BibTeX arXiv:2208.11547

Code (1)

jin-s13/COCO-WholeBody 공식 구현

Tasks

2D Human Pose EstimationNeural Architecture SearchPose Estimation

Methods 이 논문이 사용한 방법론

ZoomNet ZoomNet is a 2D human whole-body pose estimation technique. It aims to localize dense landmarks on the entire human body including face, hands, body, and feet. ZoomNet follows…

Similar Papers 제목 키워드 기반

H3WB: Human3.6M 3D WholeBody Dataset and Benchmark

2022-11-28 · ICCV 2023 1 · Yue Zhu, Nermin Samet, David Picard

We present a benchmark for 3D human whole-body pose estimation, which involves identifying accurate 3D keypoints on the entire human body, including face, hands, body, and feet. Currently, the lack of a fully annotated a…

3D Facial Landmark Localization3D Hand Pose Estimation3D Human Pose EstimationPose Estimation

ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data

2026-03-10 · Haoran Yang, Jiacheng Bao, Yucheng Xin, Haoming Song 외 arxiv

Achieving versatile and natural whole-body humanoid interaction control remains challenging due to the high cost of whole-body teleoperation data. We present ZeroWBC, a teleoperation-free framework that learns humanoid w…

Whole-Body Human Pose Estimation in the Wild

2020-07-23 · ECCV 2020 8 · Sheng Jin, Lumin Xu, Jin Xu, Can Wang 외

This paper investigates the task of 2D human whole-body pose estimation, which aims to localize dense landmarks on the entire human body including face, hands, body, and feet. As existing datasets do not have whole-body …

2D Human Pose EstimationFacial Landmark DetectionHand Pose EstimationKeypoint Estimation+1

TWIST: Teleoperated Whole-Body Imitation System

2025-05-05 · Yanjie Ze, Zixuan Chen, João Pedro Araújo, Zi-ang Cao 외

Teleoperating humanoid robots in a whole-body manner marks a fundamental step toward developing general-purpose robotic intelligence, with human motion providing an ideal interface for controlling all degrees of freedom.…

WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination

2026-09-15 · Zhuo Li, Yiming Yao, Jim Tan, Mengjie Jing 외 arxiv

World Action Models (WAMs) offer a promising approach to general-purpose robot manipulation by jointly modeling visual dynamics and actions. However, most WAM studies focus on tabletop or arm-centric manipulation, while …

Robot Manipulation