An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing
The latest developments in 3D capturing, processing, and rendering provide means to unlock novel 3D application pathways. The main elements of an integrated platform, which target tele-immersion and future 3D applications, are described in this paper, addressing the tasks of real-time capturing, robust 3D human shape/appearance reconstruction, and skeleton-based motion tracking. More specifically, initially, the details of a multiple RGB-depth (RGB-D) capturing system are given, along with a novel sensors' calibration method. A robust, fast reconstruction method from multiple RGB-D streams is then proposed, based on an enhanced variation of the volumetric Fourier transform-based method, parallelized on the Graphics Processing Unit, and accompanied with an appropriate texture-mapping algorithm. On top of that, given the lack of relevant objective evaluation methods, a novel framework is proposed for the quantitative evaluation of real-time 3D reconstruction systems. Finally, a generic, multiple depth stream-based method for accurate real-time human skeleton tracking is proposed. Detailed experimental results with multi-Kinect2 data sets verify the validity of our arguments and the effectiveness of the proposed system and methodologies.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Reconstruction3D ReconstructionSimilar Papers 제목 키워드 기반
Real-Time Human Action Recognition on Embedded Platforms
With advancements in computer vision and deep learning, video-based human action recognition (HAR) has become practical. However, due to the complexity of the computation pipeline, running HAR on live video streams incur…
Action RecognitionOptical Flow EstimationTemporal Action LocalizationMotion-compensated MR CINE reconstruction with reconstruction-driven motion estimation
In cardiac CINE, motion-compensated MR reconstruction (MCMR) is an effective approach to address highly undersampled acquisitions by incorporating motion information between frames. In this work, we propose a novel persp…
Motion EstimationPiggyback on Idle Ride-Sourcing Drivers for Integrated On-Demand and Flexible Intracity Parcel Delivery Services
This paper investigates the spatial pricing and fleet management strategies for an integrated platform that provides both ride-sourcing services and intracity parcel delivery services over a transportation network utiliz…
ManagementDemonstration of a Real-Time Testbed for D-Band Integrated Sensing and Communication
The D-band, spanning 110 GHz to 170 GHz, has emerged as a relevant frequency range for future mobile communications and radar sensing applications, particularly in the context of 6G technologies. This demonstration prese…
Integrated sensing and communicationISACVideo Motion Capture from the Part Confidence Maps of Multi-Camera Images by Spatiotemporal Filtering Using the Human Skeletal Model
This paper discusses video motion capture, namely, 3D reconstruction of human motion from multi-camera images. After the Part Confidence Maps are computed from each camera image, the proposed spatiotemporal filter is app…
3D ReconstructionPosition