Mask Detection and Breath Monitoring from Speech: on Data Augmentation, Feature Representation and Modeling
This paper introduces our approaches for the Mask and Breathing Sub-Challenge in the Interspeech COMPARE Challenge 2020. For the mask detection task, we train deep convolutional neural networks with filter-bank energies, gender-aware features, and speaker-aware features. Support Vector Machines follows as the back-end classifiers for binary prediction on the extracted deep embeddings. Several data augmentation schemes are used to increase the quantity of training data and improve our models' robustness, including speed perturbation, SpecAugment, and random erasing. For the speech breath monitoring task, we investigate different bottleneck features based on the Bi-LSTM structure. Experimental results show that our proposed methods outperform the baselines and achieve 0.746 PCC and 78.8% UAR on the Breathing and Mask evaluation set, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationSimilar Papers 제목 키워드 기반
Remote Monitoring of Patient Respiration with Mask Attachment -- A Pragmatic Solution for Medical Facilities
Remote monitoring of vital signs in infectious patients minimizes the risks of viral transmissions to healthcare professionals. Evidence indicates that donning face masks reduces the risk of viral transmissions and is no…
Frame-Wise Breath Detection with Self-Training: An Exploration of Enhancing Breath Naturalness in Text-to-Speech
Developing Text-to-Speech (TTS) systems that can synthesize natural breath is essential for human-like voice agents but requires extensive manual annotation of breath positions in training data. To this end, we propose a…
text-to-speechText to SpeechRemote Breathing Monitoring Using LiDAR Technology
Breathing monitoring is crucial in healthcare for early detection of health issues, but traditional methods face challenges like invasiveness, privacy concerns, and limited applicability in daily settings. This paper int…
PositionSpeaker and Posture Classification using Instantaneous Intraspeech Breathing Features
Acoustic features extracted from speech are widely used in problems such as biometric speaker identification and first-person activity detection. However, the use of speech for such purposes raises privacy issues as the …
Action DetectionActivity DetectionClassificationGeneral Classification+1i-Mask: An Intelligent Mask for Breath-Driven Activity Recognition
The patterns of inhalation and exhalation contain important physiological signals that can be used to anticipate human behavior, health trends, and vital parameters. Human activity recognition (HAR) is fundamentally conn…
Human Activity Recognition