Pose estimator and tracker using temporal flow maps for limbs
For human pose estimation in videos, it is significant how to use temporal information between frames. In this paper, we propose temporal flow maps for limbs (TML) and a multi-stride method to estimate and track human poses. The proposed temporal flow maps are unit vectors describing the limbs' movements. We constructed a network to learn both spatial information and temporal information end-to-end. Spatial information such as joint heatmaps and part affinity fields is regressed in the spatial network part, and the TML is regressed in the temporal network part. We also propose a data augmentation method to learn various types of TML better. The proposed multi-stride method expands the data by randomly selecting two frames within a defined range. We demonstrate that the proposed method efficiently estimates and tracks human poses on the PoseTrack 2017 and 2018 datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationPose EstimationPose TrackingSimilar Papers 제목 키워드 기반
FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking
In the domain of video tracking existing methods often grapple with a trade-off between spatial density and temporal range. Current approaches in dense optical flow estimators excel in providing spatially dense track…
Optical Flow EstimationA Top-down Approach to Articulated Human Pose Estimation and Tracking
Both the tasks of multi-person human pose estimation and pose tracking in videos are quite challenging. Existing methods can be categorized into two groups: top-down and bottom-up approaches. In this paper, following the…
Pose EstimationPose TrackingLearning Consistency Pursued Correlation Filters for Real-Time UAV Tracking
Correlation filter (CF)-based methods have demonstrated exceptional performance in visual object tracking for unmanned aerial vehicle (UAV) applications, but suffer from the undesirable boundary effect. To solve this iss…
CPUObject TrackingVisual Object TrackingEnd-to-end Flow Correlation Tracking with Spatial-temporal Attention
Discriminative correlation filters (DCF) with deep convolutional features have achieved favorable performance in recent tracking benchmarks. However, most of existing DCF trackers only consider appearance features of cur…
Optical Flow EstimationWeakly Supervised Convolutional LSTM Approach for Tool Tracking in Laparoscopic Videos
Purpose: Real-time surgical tool tracking is a core component of the future intelligent operating room (OR), because it is highly instrumental to analyze and understand the surgical activities. Current methods for surgic…
Instrument RecognitionObject DetectionSurgical tool detectionVideo Object Tracking+1