paper-with-me

홈 › Papers

BundleMoCap: Efficient, Robust and Smooth Motion Capture from Sparse Multiview Videos

2023-11-21 · Georgios Albanis, Nikolaos Zioulis, Kostas Kolomvatsos

Capturing smooth motions from videos using markerless techniques typically involves complex processes such as temporal constraints, multiple stages with data-driven regression and optimization, and bundle solving over temporal windows. These processes can be inefficient and require tuning multiple objectives across stages. In contrast, BundleMoCap introduces a novel and efficient approach to this problem. It solves the motion capture task in a single stage, eliminating the need for temporal smoothness objectives while still delivering smooth motions. BundleMoCap outperforms the state-of-the-art without increasing complexity. The key concept behind BundleMoCap is manifold interpolation between latent keyframes. By relying on a local manifold smoothness assumption, we can efficiently solve a bundle of frames using a single code. Additionally, the method can be implemented as a sliding window optimization and requires only the first frame to be properly initialized, reducing the overall computational burden. BundleMoCap's strength lies in its ability to achieve high-quality motion capture results with simplicity and efficiency. More details can be found at https://moverseai.github.io/bundle/.

📄 PDF Abstract BibTeX arXiv:2311.12679

Code (0)

등록된 구현이 없습니다.

Tasks

3D human pose and shape estimation3D Human Pose EstimationMarkerless Motion Capture

Similar Papers 제목 키워드 기반

Unsupervised Multiview Contrastive Language-Image Joint Learning with Pseudo-Labeled Prompts Via Vision-Language Model for 3D/4D Facial Expression Recognition

2025-05-14 · Muzammil Behzad

In this paper, we introduce MultiviewVLM, a vision-language model designed for unsupervised contrastive multiview representation learning of facial emotions from 3D/4D data. Our architecture integrates pseudo-labels deri…

Contrastive LearningFacial Expression RecognitionLanguage ModelingLanguage Modelling+1

Capture Dense: Markerless Motion Capture Meets Dense Pose Estimation

2018-12-05 · Xiu Li, Yebin Liu, Hanbyul Joo, Qionghai Dai 외

We present a method to combine markerless motion capture and dense pose feature estimation into a single framework. We demonstrate that dense pose information can help for multiview/single-view motion capture, and multiv…

Human ParsingMarkerless Motion CapturePose Estimation

Multiview Hessian Discriminative Sparse Coding for Image Annotation

2013-07-15 · Weifeng Liu, DaCheng Tao, Jun Cheng, Yuanyan Tang

Sparse coding represents a signal sparsely by using an overcomplete dictionary, and obtains promising performance in practical computer vision applications, especially for signal restoration tasks such as image denoising…

DenoisingImage DenoisingImage InpaintingMultiview Learning

4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras

2020-02-28 · CVPR 2020 6 · Yuxiang Zhang, Liang An, Tao Yu, Xiu Li 외

This paper contributes a novel realtime multi-person motion capture algorithm using multiview video inputs. Due to the heavy occlusions in each view, joint optimization on the multiview images and multiple temporal frame…

3D Multi-Person Pose Estimation

NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images

2024-06-11 · CVPR 2024 1 · Yufei Han, Heng Guo, Koki Fukai, Hiroaki Santo 외

We present NeRSP, a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. Reflective surface reconstruction is extremely challenging as specular reflections are view-dependent and thus …

3D ReconstructionSurface Reconstruction