Measuring Mother-Infant Emotions By Audio Sensing
It has been suggested in developmental psychology literature that the communication of affect between mothers and their infants correlates with the socioemotional and cognitive development of infants. In this study, we obtained day-long audio recordings of 10 mother-infant pairs in order to study their affect communication in speech with a focus on mother's speech. In order to build a model for speech emotion detection, we used the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) and trained a Convolutional Neural Nets model which is able to classify 6 different emotions at 70% accuracy. We applied our model to mother's speech and found the dominant emotions were angry and sad, which were not true. Based on our own observations, we concluded that emotional speech databases made with the help of actors cannot generalize well to real-life settings, suggesting an active learning or unsupervised approach in the future.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningSimilar Papers 제목 키워드 기반
Review: dual benefits, compositions, recommended storage, and intake duration of mother's milk
Breastfeeding benefits both infants and mothers. Nutrients in mother's milk help protect infants from multiple diseases including infections, cancers, diabetes, gastrointestinal and respiratory diseases. We performed lit…
Literature MiningVisualizations of Complex Sequences of Family-Infant Vocalizations Using Bag-of-Audio-Words Approach Based on Wav2vec 2.0 Features
In the U.S., approximately 15-17% of children 2-8 years of age are estimated to have at least one diagnosed mental, behavioral or developmental disorder. However, such disorders often go undiagnosed, and the ability to e…
speaker-diarizationSpeaker DiarizationNeuroadaptive electroencephalography: a proof-of-principle study in infants
A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmenta…
Bayesian OptimisationEEGElectroencephalogram (EEG)Enhancing Infant Crying Detection with Gradient Boosting for Improved Emotional and Mental Health Diagnostics
Infant crying can serve as a crucial indicator of various physiological and emotional states. This paper introduces a comprehensive approach detecting infant cries within audio data. We integrate Wav2Vec with traditional…
Ramadan and Infants Health Outcomes
Previous studies show that prenatal shocks to embryos could have adverse impacts on health endowment at birth. Using the universe of birth data and a difference-in-difference-in-difference strategy, I find that exposure …