Remote Blood Oxygen Estimation From Videos Using Neural Networks
Blood oxygen saturation (SpO$_2$) is an essential indicator of respiratory functionality and is receiving increasing attention during the COVID-19 pandemic. Clinical findings show that it is possible for COVID-19 patients to have significantly low SpO$_2$ before any obvious symptoms. The prevalence of cameras has motivated researchers to investigate methods for monitoring SpO$_2$ using videos. Most prior schemes involving smartphones are contact-based: They require a fingertip to cover the phone's camera and the nearby light source to capture re-emitted light from the illuminated tissue. In this paper, we propose the first convolutional neural network based noncontact SpO$_2$ estimation scheme using smartphone cameras. The scheme analyzes the videos of a participant's hand for physiological sensing, which is convenient and comfortable, and can protect their privacy and allow for keeping face masks on. We design our neural network architectures inspired by the optophysiological models for SpO$_2$ measurement and demonstrate the explainability by visualizing the weights for channel combination. Our proposed models outperform the state-of-the-art model that is designed for contact-based SpO$_2$ measurement, showing the potential of our proposed method to contribute to public health. We also analyze the impact of skin type and the side of a hand on SpO$_2$ estimation performance.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes
Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rPPG) and contact video PPG (cPPG). Monito…
SpO2 estimationBlood Oxygen Saturation Estimation from Facial Video via DC and AC components of Spatio-temporal Map
Peripheral blood oxygen saturation (SpO2), an indicator of oxygen levels in the blood, is one of the most important physiological parameters. Although SpO2 is usually measured using a pulse oximeter, non-contact SpO2 est…
SpO2 estimationRemote photonic sensing of blood oxygen saturation via tracking of anomalies in micro-saccades patterns
Speckle pattern analysis has been found by many researchers to be applicable to remote sensing of various biomedical parameters. This paper shows how analysis of dynamic differential speckle patterns scattered from subje…
BIG-bench Machine LearningA Web Application for Experimenting and Validating Remote Measurement of Vital Signs
With a surge in online medical advising remote monitoring of patient vitals is required. This can be facilitated with the Remote Photoplethysmography (rPPG) techniques that compute vital signs from facial videos. It invo…
Heart Rate VariabilityReViSe: Remote Vital Signs Measurement Using Smartphone Camera
We propose an end-to-end framework to measure people's vital signs including Heart Rate (HR), Heart Rate Variability (HRV), Oxygen Saturation (SpO2) and Blood Pressure (BP) based on the rPPG methodology from the video of…
Heart Rate Variability