paper-with-me

홈 › Papers

PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring

2025-07-25 · Jiyao Wang, Xiao Yang, Qingyong Hu, Jiankai Tang, Can Liu, Dengbo He, Yuntao Wang, Yingcong Chen, Kaishun Wu arxiv

Robust and unobtrusive in-vehicle physiological monitoring is crucial for ensuring driving safety and user experience. While remote physiological measurement (RPM) offers a promising non-invasive solution, its translation to real-world driving scenarios is critically constrained by the scarcity of comprehensive datasets. Existing resources are often limited in scale, modality diversity, the breadth of biometric annotations, and the range of captured conditions, thereby omitting inherent real-world challenges in driving. Here, we present PhysDrive, the first large-scale multimodal dataset for contactless in-vehicle physiological sensing with dedicated consideration on various modality settings and driving factors. PhysDrive collects data from 48 drivers, including synchronized RGB, near-infrared camera, and raw mmWave radar data, accompanied with six synchronized ground truths (ECG, BVP, Respiration, HR, RR, and SpO2). It covers a wide spectrum of naturalistic driving conditions, including driver motions, dynamic natural light, vehicle types, and road conditions. We extensively evaluate both signal-processing and deep-learning methods on PhysDrive, establishing a comprehensive benchmark across all modalities, and release full open-source code with compatibility for mainstream public toolboxes. We envision PhysDrive will serve as a foundational resource and accelerate research on multimodal driver monitoring and smart-cockpit systems.

📄 PDF Abstract BibTeX arXiv:2507.19172

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

2020-07-16 · ECCV 2020 8 · Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li 외

Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under th…

Heart Rate Variability

The 1st Challenge on Remote Physiological Signal Sensing (RePSS)

2020-03-26 · Xiaobai Li, Hu Han, Hao Lu, Xuesong Niu 외

Remote measurement of physiological signals from videos is an emerging topic. The topic draws great interests, but the lack of publicly available benchmark databases and a fair validation platform are hindering its furth…

Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrast

2022-08-08 · Zhaodong Sun, Xiaobai Li

Video-based remote physiological measurement utilizes face videos to measure the blood volume change signal, which is also called remote photoplethysmography (rPPG). Supervised methods for rPPG measurements achieve state…

PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurement

2024-05-10 · Jiyao Wang, Hao Lu, Ange Wang, Xiao Yang 외

Remote photoplethysmography (rPPG) has been widely applied to measure heart rate from face videos. To increase the generalizability of the algorithms, domain generalization (DG) attracted increasing attention in rPPG. Ho…

Domain GeneralizationMulti-Task Learning

EMPD: An Event-based Multimodal Physiological Dataset for Remote Pulse Wave Detection

2026-03-17 · Qian Feng, Pengfei Li, Rongshan Gao, Jiale Xu 외 arxiv

Remote photoplethysmography (rPPG) based on traditional frame-based cameras often struggles with motion artifacts and limited temporal resolution. To address these limitations, we introduce EMPD (Event-based Multimodal P…