Key Frame Proposal Network for Efficient Pose Estimation in Videos
Human pose estimation in video relies on local information by either estimating each frame independently or tracking poses across frames. In this paper, we propose a novel method combining local approaches with global context. We introduce a light weighted, unsupervised, key frame proposal network (K-FPN) to select informative frames and a learned dictionary to recover the entire pose sequence from these frames. The K-FPN speeds up the pose estimation and provides robustness to bad frames with occlusion, motion blur, and illumination changes, while the learned dictionary provides global dynamic context. Experiments on Penn Action and sub-JHMDB datasets show that the proposed method achieves state-of-the-art accuracy, with substantial speed-up.
Code (1)
Tasks
Pose EstimationSimilar Papers 제목 키워드 기반
Generic Tubelet Proposals for Action Localization
We develop a novel framework for action localization in videos. We propose the Tube Proposal Network (TPN), which can generate generic, class-independent, video-level tubelet proposals in videos. The generated tubelet pr…
Action ClassificationAction LocalizationGeneral ClassificationObject Detection in Videos with Tubelet Proposal Networks
Object detection in videos has drawn increasing attention recently with the introduction of the large-scale ImageNet VID dataset. Different from object detection in static images, temporal information in videos is vital …
Objectobject-detectionObject DetectionObject TrackingAutomatic Action Annotation in Weakly Labeled Videos
Manual spatio-temporal annotation of human action in videos is laborious, requires several annotators and contains human biases. In this paper, we present a weakly supervised approach to automatically obtain spatio-tempo…
Optical Flow EstimationAdaptive Proposal Generation Network for Temporal Sentence Localization in Videos
We address the problem of temporal sentence localization in videos (TSLV). Traditional methods follow a top-down framework which localizes the target segment with pre-defined segment proposals. Although they have achieve…
SentenceLearning from Single Timestamps: Complexity Estimation in Laparoscopic Cholecystectomy
Purpose: Accurate assessment of surgical complexity is essential in Laparoscopic Cholecystectomy (LC), where severe inflammation is associated with longer operative times and increased risk of postoperative complications…