Optical Flow-based 3D Human Motion Estimation from Monocular Video
We present a generative method to estimate 3D human motion and body shape from monocular video. Under the assumption that starting from an initial pose optical flow constrains subsequent human motion, we exploit flow to find temporally coherent human poses of a motion sequence. We estimate human motion by minimizing the difference between computed flow fields and the output of an artificial flow renderer. A single initialization step is required to estimate motion over multiple frames. Several regularization functions enhance robustness over time. Our test scenarios demonstrate that optical flow effectively regularizes the under-constrained problem of human shape and motion estimation from monocular video.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Self-Supervised Monocular Scene Flow Estimation
Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly i…
Depth EstimationMonocular Depth EstimationOptical Flow EstimationScene Flow Estimation+1Motion Aware ViT-based Framework for Monocular 6-DoF Spacecraft Pose Estimation
Monocular 6-DoF pose estimation plays an important role in multiple spacecraft missions. Most existing pose estimation approaches rely on single images with static keypoint localisation, failing to exploit valuable tempo…
Pose EstimationFlow-Motion and Depth Network for Monocular Stereo and Beyond
We propose a learning-based method that solves monocular stereo and can be extended to fuse depth information from multiple target frames. Given two unconstrained images from a monocular camera with known intrinsic calib…
Depth EstimationOptical Flow EstimationUnsupervised Learning of Depth, Optical Flow and Pose with Occlusion from 3D Geometry
In autonomous driving, monocular sequences contain lots of information. Monocular depth estimation, camera ego-motion estimation and optical flow estimation in consecutive frames are high-profile concerns recently. By an…
3D geometryAutonomous DrivingDepth And Camera MotionDepth Estimation+3Speed estimation evaluation on the KITTI benchmark based on motion and monocular depth information
In this technical report we investigate speed estimation of the ego-vehicle on the KITTI benchmark using state-of-the-art deep neural network based optical flow and single-view depth prediction methods. Using a straightf…
Depth EstimationDepth PredictionOptical Flow EstimationVehicle Speed Estimation