M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings
Portable physiological monitoring is essential for early detection and management of cardiovascular disease, but current methods often require specialized equipment that limits accessibility or impose impractical postures that patients cannot maintain. Video-based photoplethysmography on smartphones offers a convenient noninvasive alternative, yet it still faces reliability challenges caused by motion artifacts, lighting variations, and single-view constraints. Few studies have demonstrated reliable application to cardiovascular patients, and no widely used open datasets exist for cross-device accuracy. To address these limitations, we introduce the M3PD dataset, the first publicly available dual-view mobile photoplethysmography dataset, comprising synchronized facial and fingertip videos captured simultaneously via front and rear smartphone cameras from 60 participants (including 47 cardiovascular patients). Building on this dual-view setting, we further propose F3Mamba, which fuses the facial and fingertip views through Mamba-based temporal modeling. The model reduces heart-rate error by 21.9 to 30.2 percent over existing single-view baselines while improving robustness in challenging real-world scenarios. Data and code: https://github.com/Health-HCI-Group/F3Mamba.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Bring Your Rear Cameras for Egocentric 3D Human Pose Estimation
Egocentric 3D human pose estimation has been actively studied using cameras installed in front of a head-mounted device (HMD). While frontal placement is the optimal and the only option for some tasks, such as hand track…
3D Human Pose Estimation3D ReconstructionPose EstimationPose TrackingAQIFormer: A Transformer-Based Multi-View Architecture for Cross-City Air Quality Classification
Air pollution represents one of the most critical environmental and public health challenges globally, with traditional sensor-based monitoring systems facing significant scalability and economic constraints. Image-based…
Multi-Task LearningsensVLA: Spatially-Grounded Vision-Language-Action Model for Autonomous Wheel Loader
Autonomous wheel-loader control requires joint reasoning over task semantics, egocentric vision, proprioception, and 3D scene geometry. We present sensVLA, a Vision-Language-Action (VLA) architecture that combines a Qwen…
MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing
Camera-based contactless photoplethysmography refers to a set of popular techniques for contactless physiological measurement. The current state-of-the-art neural models are typically trained in a supervised manner using…
Local nature of 0.1 Hz oscillations in microcirculation is confirmed by imaging photoplethysmography
Low-frequency oscillations in the human circulatory system is important for basic physiology and practical applications in clinical medicine. Our objective was to study which mechanism (central or local) is responsible f…
DiagnosticHeart Rate Variability