KBody: Towards general, robust, and aligned monocular whole-body estimation
KBody is a method for fitting a low-dimensional body model to an image. It follows a predict-and-optimize approach, relying on data-driven model estimates for the constraints that will be used to solve for the body's parameters. Acknowledging the importance of high quality correspondences, it leverages ``virtual joints" to improve fitting performance, disentangles the optimization between the pose and shape parameters, and integrates asymmetric distance fields to strike a balance in terms of pose and shape capturing capacity, as well as pixel alignment. We also show that generative model inversion offers a strong appearance prior that can be used to complete partial human images and used as a building block for generalized and robust monocular body fitting. Project page: https://zokin.github.io/KBody.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DanceHMR: Hand-Aware Whole-Body Human Mesh Recovery from Monocular Videos
Monocular video human mesh recovery is essential for digital humans, avatar animation, and embodied simulation, where both temporal stability and expressive whole-body motion are required. Existing video HMR methods prod…
Human Mesh RecoveryRTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation
Whole-body pose estimation is a challenging task that requires simultaneous prediction of keypoints for the body, hands, face, and feet. Whole-body pose estimation aims to predict fine-grained pose information for the hu…
2D Human Pose Estimation2D Pose Estimation3D Human Pose Estimation3D Pose Estimation+1FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration
Although the essential nuance of human motion is often conveyed as a combination of body movements and hand gestures, the existing monocular motion capture approaches mostly focus on either body motion capture only ignor…
3D Hand Pose Estimation3D Human Reconstruction3D Pose EstimationregressionEgocentric Whole-Body Human Mesh Recovery with Prior-Guided Learning
Egocentric human mesh recovery (HMR) from monocular head-mounted cameras is increasingly important for AR/VR applications, but remains challenging due to the lack of reliable ground-truth (GT) annotations based on parame…
Human Mesh RecoveryPose EstimationTowards Robust and Expressive Whole-body Human Pose and Shape Estimation
Whole-body pose and shape estimation aims to jointly predict different behaviors (e.g., pose, hand gesture, facial expression) of the entire human body from a monocular image. Existing methods often exhibit degraded perf…