FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras
Aiming at automatic, convenient and non-instrusive motion capture, this paper presents a new generation markerless motion capture technique, the FlyCap system, to capture surface motions of moving characters using multiple autonomous flying cameras (autonomous unmanned aerial vehicles(UAV) each integrated with an RGBD video camera). During data capture, three cooperative flying cameras automatically track and follow the moving target who performs large scale motions in a wide space. We propose a novel non-rigid surface registration method to track and fuse the depth of the three flying cameras for surface motion tracking of the moving target, and simultaneously calculate the pose of each flying camera. We leverage the using of visual-odometry information provided by the UAV platform, and formulate the surface tracking problem in a non-linear objective function that can be linearized and effectively minimized through a Gaussian-Newton method. Quantitative and qualitative experimental results demonstrate the competent and plausible surface and motion reconstruction results
Code (0)
등록된 구현이 없습니다.
Tasks
Markerless Motion CaptureVisual OdometrySimilar Papers 제목 키워드 기반
Markerless Outdoor Human Motion Capture Using Multiple Autonomous Micro Aerial Vehicles
Capturing human motion in natural scenarios means moving motion capture out of the lab and into the wild. Typical approaches rely on fixed, calibrated, cameras and reflective markers on the body, significantly limiting t…
Markerless Motion CaptureDifferentiable Biomechanics Unlocks Opportunities for Markerless Motion Capture
Recent developments have created differentiable physics simulators designed for machine learning pipelines that can be accelerated on a GPU. While these can simulate biomechanical models, these opportunities have not bee…
GPUMarkerless Motion CaptureCapture Dense: Markerless Motion Capture Meets Dense Pose Estimation
We present a method to combine markerless motion capture and dense pose feature estimation into a single framework. We demonstrate that dense pose information can help for multiview/single-view motion capture, and multiv…
Human ParsingMarkerless Motion CapturePose EstimationQuantifying Jump Height Using Markerless Motion Capture with a Single Smartphone
Goal: The countermovement jump (CMJ) is commonly used to measure lower-body explosive power. This study evaluates how accurately markerless motion capture (MMC) with a single smartphone can measure bilateral and unilater…
Camera CalibrationMarkerless Motion CaptureA Dataset and Evaluation for Complex 4D Markerless Human Motion Capture
Marker-based motion capture (MoCap) systems have long been the gold standard for accurate 4D human modeling, yet their reliance on specialized hardware and markers limits scalability and real-world deployment. Advancing …