Learning Multi-Human Optical Flow
The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain of human motion. Therefore, we develop a dataset of multi-human optical flow and train optical flow networks on this dataset. We use a 3D model of the human body and motion capture data to synthesize realistic flow fields in both single- and multi-person images. We then train optical flow networks to estimate human flow fields from pairs of images. We demonstrate that our trained networks are more accurate than a wide range of top methods on held-out test data and that they can generalize well to real image sequences. The code, trained models and the dataset are available for research.
Code (2)
Tasks
Optical Flow EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bootstrapping Human Optical Flow and Pose
We propose a bootstrapping framework to enhance human optical flow and pose. We show that, for videos involving humans in scenes, we can improve both the optical flow and the pose estimation quality of humans by consider…
Optical Flow EstimationPose EstimationOptical Flow-based 3D Human Motion Estimation from Monocular Video
We present a generative method to estimate 3D human motion and body shape from monocular video. Under the assumption that starting from an initial pose optical flow constrains subsequent human motion, we exploit flow to …
Motion EstimationOptical Flow EstimationCombining Spatio-Temporal Appearance Descriptors and Optical Flow for Human Action Recognition in Video Data
This paper proposes combining spatio-temporal appearance (STA) descriptors with optical flow for human action recognition. The STA descriptors are local histogram-based descriptors of space-time, suitable for building a …
Action RecognitionOptical Flow EstimationTemporal Action LocalizationLearning Human Optical Flow
The optical flow of humans is well known to be useful for the analysis of human action. Given this, we devise an optical flow algorithm specifically for human motion and show that it is superior to generic flow methods. …
Optical Flow EstimationHuPerFlow: A Comprehensive Benchmark for Human vs. Machine Motion Estimation Comparison
As AI models are increasingly integrated into applications involving human interaction, understanding the alignment between human perception and machine vision has become essential. One example is the estimation of v…
Motion EstimationOptical Flow Estimation