BlanketGen - A synthetic blanket occlusion augmentation pipeline for MoCap datasets
Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that augments videos with synthetic blanket occlusions. With this pipeline, we generated an augmented version of the pose estimation dataset 3DPW called BlanketGen-3DPW. We then used this new dataset to fine-tune a Deep Learning model to improve its performance in these scenarios with promising results. Code and further information are available at https://gitlab.inesctec.pt/brain-lab/brain-lab-public/blanket-gen-releases.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation
Human Pose Estimation (HPE) from monocular RGB images is crucial for clinical in-bed skeleton-based action recognition, however, it poses unique challenges for HPE models due to the frequent presence of blankets occludin…
Action RecognitionData AugmentationPose EstimationSkeleton Based Action RecognitionGeometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation
Robust in-bed human pose estimation under blanket occlusion remains challenging due to the scarcity of reliable labeled training data for heavily covered poses. Existing approaches rely on multi-modal sensing or image-to…
Image-to-Image TranslationPose EstimationTowards Accurate Cross-Domain In-Bed Human Pose Estimation
Human behavioral monitoring during sleep is essential for various medical applications. Majority of the contactless human pose estimation algorithms are based on RGB modality, causing ineffectiveness in in-bed pose estim…
Data AugmentationKnowledge DistillationPose EstimationMultimodal In-bed Pose and Shape Estimation under the Blankets
Humans spend vast hours in bed -- about one-third of the lifetime on average. Besides, a human at rest is vital in many healthcare applications. Typically, humans are covered by a blanket when resting, for which we propo…
BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image
Contact pressure between the human body and its surroundings has important implications. For example, it plays a role in comfort, safety, posture, and health. We present a method that infers contact pressure between a hu…
Image Generation