paper-with-me

Papers

Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimation

2021-11-16 · William McNally, Kanav Vats, Alexander Wong, John McPhee

In keypoint estimation tasks such as human pose estimation, heatmap-based regression is the dominant approach despite possessing notable drawbacks: heatmaps intrinsically suffer from quantization error and require excessive computation to generate and post-process. Motivated to find a more efficient solution, we propose to model individual keypoints and sets of spatially related keypoints (i.e., poses) as objects within a dense single-stage anchor-based detection framework. Hence, we call our method KAPAO (pronounced "Ka-Pow"), for Keypoints And Poses As Objects. KAPAO is applied to the problem of single-stage multi-person human pose estimation by simultaneously detecting human pose and keypoint objects and fusing the detections to exploit the strengths of both object representations. In experiments, we observe that KAPAO is faster and more accurate than previous methods, which suffer greatly from heatmap post-processing. The accuracy-speed trade-off is especially favourable in the practical setting when not using test-time augmentation. Source code: https://github.com/wmcnally/kapao.

📄 PDF Abstract BibTeX arXiv:2111.08557

Code (1)

wmcnally/kapao 공식 구현 pytorch

Tasks

Keypoint EstimationPose Estimation

Similar Papers 제목 키워드 기반

Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

2019-11-24 · Jia Li, Wen Su, Zengfu Wang

We rethink a well-know bottom-up approach for multi-person pose estimation and propose an improved one. The improved approach surpasses the baseline significantly thanks to (1) an intuitional yet more sensible representa…

2D Human Pose EstimationKeypoint DetectionMulti-Person Pose EstimationPose Estimation

CoKe: Localized Contrastive Learning for Robust Keypoint Detection

2020-09-29 · Yutong Bai, Angtian Wang, Adam Kortylewski, Alan Yuille

In this paper, we introduce a contrastive learning framework for keypoint detection (CoKe). Keypoint detection differs from other visual tasks where contrastive learning has been applied because the input is a set of ima…

Contrastive LearningKeypoint DetectionRepresentation Learning

USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation

2022-09-28 · Zhengrong Xue, Zhecheng Yuan, Jiashun Wang, Xueqian Wang 외

Can a robot manipulate intra-category unseen objects in arbitrary poses with the help of a mere demonstration of grasping pose on a single object instance? In this paper, we try to address this intriguing challenge by us…

Keypoint DetectionObject

Neural Interactive Keypoint Detection

2023-08-20 · ICCV 2023 1 · Jie Yang, Ailing Zeng, Feng Li, Shilong Liu 외

This work proposes an end-to-end neural interactive keypoint detection framework named Click-Pose, which can significantly reduce more than 10 times labeling costs of 2D keypoint annotation compared with manual-only anno…

DecoderKeypoint Detection

SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Data

2023-08-10 · ICCV 2023 1 · Mohammad Zohaib, Alessio Del Bue

This paper proposes a new method to infer keypoints from arbitrary object categories in practical scenarios where point cloud data (PCD) are noisy, down-sampled and arbitrarily rotated. Our proposed model adheres to the …