Parallel Multi-Scale Networks with Deep Supervision for Hand Keypoint Detection
Keypoint detection plays an important role in a wide range of applications. However, predicting keypoints of small objects such as human hands is a challenging problem. Recent works fuse feature maps of deep Convolutional Neural Networks (CNNs), either via multi-level feature integration or multi-resolution aggregation. Despite achieving some success, the feature fusion approaches increase the complexity and the opacity of CNNs. To address this issue, we propose a novel CNN model named Multi-Scale Deep Supervision Network (P-MSDSNet) that learns feature maps at different scales with deep supervisions to produce attention maps for adaptive feature propagation from layers to layers. P-MSDSNet has a multi-stage architecture which makes it scalable while its deep supervision with spatial attention improves transparency to the feature learning at each stage. We show that P-MSDSNet outperforms the state-of-the-art approaches on benchmark datasets while requiring fewer number of parameters. We also show the application of P-MSDSNet to quantify finger tapping hand movements in a neuroscience study.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionSimilar Papers 제목 키워드 기반
Multi-Scale Structure-Aware Network for Human Pose Estimation
We develop a robust multi-scale structure-aware neural network for human pose estimation. This method improves the recent deep conv-deconv hourglass models with four key improvements: (1) multi-scale supervision to stren…
Pose EstimationregressionPoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation
We study multi-dataset training (MDT) for pose estimation, where skeletal heterogeneity presents a unique challenge that existing methods have yet to address. In traditional domains, \eg regression and classification, MD…
Pose EstimationRecurrent Feature Mining and Keypoint Mixup Padding for Category-Agnostic Pose Estimation
Category-agnostic pose estimation aims to locate keypoints on query images according to a few annotated support images for arbitrary novel classes. Existing methods generally extract support features via heatmap pooling,…
Category-Agnostic Pose EstimationPose EstimationMulti-Scale Supervised Network for Human Pose Estimation
Human pose estimation is an important topic in computer vision with many applications including gesture and activity recognition. However, pose estimation from image is challenging due to appearance variations, occlusion…
Activity RecognitionKeypoint DetectionPose EstimationregressionER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation
Single-stage multi-person pose estimation aims to jointly perform human localization and keypoint prediction within a unified framework, offering advantages in inference efficiency and architectural simplicity. Consequen…
Multi-Person Pose EstimationRepresentation LearningObject Detection