paper-with-me

홈 › Papers

Towards Synthetic Data Generation for Improved Pain Recognition in Videos under Patient Constraints

2024-09-24 · Jonas Nasimzada, Jens Kleesiek, Ken Herrmann, Alina Roitberg, Constantin Seibold

Recognizing pain in video is crucial for improving patient-computer interaction systems, yet traditional data collection in this domain raises significant ethical and logistical challenges. This study introduces a novel approach that leverages synthetic data to enhance video-based pain recognition models, providing an ethical and scalable alternative. We present a pipeline that synthesizes realistic 3D facial models by capturing nuanced facial movements from a small participant pool, and mapping these onto diverse synthetic avatars. This process generates 8,600 synthetic faces, accurately reflecting genuine pain expressions from varied angles and perspectives. Utilizing advanced facial capture techniques, and leveraging public datasets like CelebV-HQ and FFHQ-UV for demographic diversity, our new synthetic dataset significantly enhances model training while ensuring privacy by anonymizing identities through facial replacements. Experimental results demonstrate that models trained on combinations of synthetic data paired with a small amount of real participants achieve superior performance in pain recognition, effectively bridging the gap between synthetic simulations and real-world applications. Our approach addresses data scarcity and ethical concerns, offering a new solution for pain detection and opening new avenues for research in privacy-preserving dataset generation. All resources are publicly available to encourage further innovation in this field.

📄 PDF Abstract BibTeX arXiv:2409.16382

Code (1)

JonasNasimzada/LetsPlay4Emotion 공식 구현 pytorch

Tasks

Dataset GenerationPrivacy PreservingSynthetic Data Generation

Similar Papers 제목 키워드 기반

Synthetic Thermal and RGB Videos for Automatic Pain Assessment utilizing a Vision-MLP Architecture

2024-07-29 · Stefanos Gkikas, Manolis Tsiknakis

Pain assessment is essential in developing optimal pain management protocols to alleviate suffering and prevent functional decline in patients. Consequently, reliable and accurate automatic pain assessment systems are es…

Management

SynGallery: A Synthetic Gallery of Real Paintings for Instance-Level Artwork Recognition

2026-07-21 · Patryk Bartkowiak, Jakub Markil, Bartosz Kotrys, Dominik Michels 외 arxiv

Instance-level artwork recognition requires matching a handheld visitor photograph to a specific work in a large museum collection. This is challenging because painting datasets typically provide clean catalog images for…

Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?

2025-12-18 · Serafino Pandolfini, Lorenzo Pellegrini, Matteo Ferrara, Davide Maltoni arxiv

The rapid progress of generative AI has enabled highly realistic image manipulations, including inpainting and region-level editing. These approaches preserve most of the original visual context and are increasingly expl…

DeepFake Detection

Explainable Face Recognition

2020-08-03 · ECCV 2020 8 · Jonathan R. Williford, Brandon B. May, Jeffrey Byrne

Explainable face recognition is the problem of explaining why a facial matcher matches faces. In this paper, we provide the first comprehensive benchmark and baseline evaluation for explainable face recognition. We defin…

Face RecognitionTriplet

UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance

2022-10-28 · Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu 외

Diffusion generative models have recently greatly improved the power of text-conditioned image generation. Existing image generation models mainly include text conditional diffusion model and cross-modal guided diffusion…

Image GenerationImage-text matchingLanguage ModelingLanguage Modelling+1