Efficient Deep Learning-based Estimation of the Vital Signs on Smartphones
With the increasing use of smartphones in our daily lives, these devices have become capable of performing many complex tasks. Concerning the need for continuous monitoring of vital signs, especially for the elderly or those with certain types of diseases, the development of algorithms that can estimate vital signs using smartphones has attracted researchers worldwide. In particular, researchers have been exploring ways to estimate vital signs, such as heart rate, oxygen saturation levels, and respiratory rate, using algorithms that can be run on smartphones. However, many of these algorithms require multiple pre-processing steps that might introduce some implementation overheads or require the design of a couple of hand-crafted stages to obtain an optimal result. To address this issue, this research proposes a novel end-to-end solution to mobile-based vital sign estimation using deep learning that eliminates the need for pre-processing. By using a fully convolutional architecture, the proposed model has much fewer parameters and less computational complexity compared to the architectures that use fully-connected layers as the prediction heads. This also reduces the risk of overfitting. Additionally, a public dataset for vital sign estimation, which includes 62 videos collected from 35 men and 27 women, is provided. Overall, the proposed end-to-end approach promises significantly improved efficiency and performance for on-device health monitoring on readily available consumer electronics.
Code (2)
Tasks
Deep LearningHeart rate estimationSpO2 estimationSimilar Papers 제목 키워드 기반
Harmonic MUSIC Method for mmWave Radar-based Vital Sign Estimation
This paper investigates the application of millimeter-wave (mmWave) radar for the estimation of human vital signs. Aiming to obtain more accurate frequency estimation for periodic signals of respiration and heartbeat, we…
Enhancing Vital Sign Estimation Performance of FMCW MIMO Radar by Prior Human Shape Recognition
Radio technology enabled contact-free human posture and vital sign estimation is promising for health monitoring. Radio systems at millimeter-wave (mmWave) frequencies advantageously bring large bandwidth, multi-antenna …
VitalLens: Take A Vital Selfie
This report introduces VitalLens, an app that estimates vital signs such as heart rate and respiration rate from selfie video in real time. VitalLens uses a computer vision model trained on a diverse dataset of video and…
Heart rate estimationPOSRespiratory Rate EstimationPENGUIN: General Vital Sign Reconstruction from PPG with Flow Matching State Space Model
Photoplethysmography (PPG) plays a crucial role in continuous cardiovascular health monitoring as a non-invasive and cost-effective modality. However, PPG signals are susceptible to motion artifacts and noise, making acc…
User Authentication and Vital Signs Extraction from Low-Frame-Rate and Monochrome No-contact Fingerprint Captures
We present our work on leveraging low-frame-rate monochrome (blue light) videos of fingertips, captured with an off-the-shelf fingerprint capture device, to extract vital signs and identify users. These videos utilize ph…
Heart rate estimationPhotoplethysmography (PPG)User Identification