paper-with-me

홈 › Papers

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

2021-10-10 · Daniel McDuff, Xin Liu, Javier Hernandez, Erroll Wood, Tadas Baltrusaitis

Synthetic data is a powerful tool in training data hungry deep learning algorithms. However, to date, camera-based physiological sensing has not taken full advantage of these techniques. In this work, we leverage a high-fidelity synthetics pipeline for generating videos of faces with faithful blood flow and breathing patterns. We present systematic experiments showing how physiologically-grounded synthetic data can be used in training camera-based multi-parameter cardiopulmonary sensing. We provide empirical evidence that heart and breathing rate measurement accuracy increases with the number of synthetic avatars in the training set. Furthermore, training with avatars with darker skin types leads to better overall performance than training with avatars with lighter skin types. Finally, we discuss the opportunities that synthetics present in the domain of camera-based physiological sensing and limitations that need to be overcome.

📄 PDF Abstract BibTeX arXiv:2110.04902

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SCAMPS: Synthetics for Camera Measurement of Physiological Signals

2022-06-08 · Daniel McDuff, Miah Wander, Xin Liu, Brian L. Hill 외

The use of cameras and computational algorithms for noninvasive, low-cost and scalable measurement of physiological (e.g., cardiac and pulmonary) vital signs is very attractive. However, diverse data representing a range…

DescriptiveDiversityHeart Rate Variability

RGB Camera-based Physiological Sensing: Challenges and Future Directions

2021-10-26 · Xin Liu, Shwetak Patel, Daniel McDuff

Numerous real-world applications have been driven by the recent algorithmic advancement of artificial intelligence (AI). Healthcare is no exception and AI technologies have great potential to revolutionize the industry. …

EMPD: An Event-based Multimodal Physiological Dataset for Remote Pulse Wave Detection

2026-03-17 · Qian Feng, Pengfei Li, Rongshan Gao, Jiale Xu 외 arxiv

Remote photoplethysmography (rPPG) based on traditional frame-based cameras often struggles with motion artifacts and limited temporal resolution. To address these limitations, we introduce EMPD (Event-based Multimodal P…

Camera Measurement of Physiological Vital Signs

2021-11-22 · Daniel McDuff

The need for remote tools for healthcare monitoring has never been more apparent. Camera measurement of vital signs leverages imaging devices to compute physiological changes by analyzing images of the human body. Buildi…

Deep-BrownConrady: Prediction of Camera Calibration and Distortion Parameters Using Deep Learning and Synthetic Data

2025-01-24 · Faiz Muhammad Chaudhry, Jarno Ralli, Jerome Leudet, Fahad Sohrab 외

This research addresses the challenge of camera calibration and distortion parameter prediction from a single image using deep learning models. The main contributions of this work are: (1) demonstrating that a deep learn…

Autonomous DrivingCamera CalibrationDeep LearningParameter Prediction