paper-with-me

홈 › Papers

Emotion Recognition of the Singing Voice: Toward a Real-Time Analysis Tool for Singers

2021-05-01 · Daniel Szelogowski

Current computational-emotion research has focused on applying acoustic properties to analyze how emotions are perceived mathematically or used in natural language processing machine learning models. While recent interest has focused on analyzing emotions from the spoken voice, little experimentation has been performed to discover how emotions are recognized in the singing voice -- both in noiseless and noisy data (i.e., data that is either inaccurate, difficult to interpret, has corrupted/distorted/nonsense information like actual noise sounds in this case, or has a low ratio of usable/unusable information). Not only does this ignore the challenges of training machine learning models on more subjective data and testing them with much noisier data, but there is also a clear disconnect in progress between advancing the development of convolutional neural networks and the goal of emotionally cognizant artificial intelligence. By training a new model to include this type of information with a rich comprehension of psycho-acoustic properties, not only can models be trained to recognize information within extremely noisy data, but advancement can be made toward more complex biofeedback applications -- including creating a model which could recognize emotions given any human information (language, breath, voice, body, posture) and be used in any performance medium (music, speech, acting) or psychological assistance for patients with disorders such as BPD, alexithymia, autism, among others. This paper seeks to reflect and expand upon the findings of related research and present a stepping-stone toward this end goal.

📄 PDF Abstract BibTeX arXiv:2105.00173

Code (1)

danielathome19/Sung-EmotioNN-Detector 공식 구현 tf

Tasks

BIG-bench Machine LearningEmotion Recognition

Similar Papers 제목 키워드 기반

Real-Time and Accurate: Zero-shot High-Fidelity Singing Voice Conversion with Multi-Condition Flow Synthesis

2024-05-23 · Hui Li, Hongyu Wang, Zhijin Chen, Bohan Sun 외

Singing voice conversion is to convert the source singing voice into the target singing voice except for the content. Currently, flow-based models can complete the task of voice conversion, but they struggle to effective…

AttributeDecoderVoice Conversion

StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis

2023-12-17 · Yu Zhang, Rongjie Huang, RuiQi Li, Jinzheng He 외

Style transfer for out-of-domain (OOD) singing voice synthesis (SVS) focuses on generating high-quality singing voices with unseen styles (such as timbre, emotion, pronunciation, and articulation skills) derived from ref…

QuantizationSinging Voice SynthesisStyle Transfer

JukeBox: A Multilingual Singer Recognition Dataset

2020-08-08 · Anurag Chowdhury, Austin Cozzo, Arun Ross

A text-independent speaker recognition system relies on successfully encoding speech factors such as vocal pitch, intensity, and timbre to achieve good performance. A majority of such systems are trained and evaluated us…

Speaker RecognitionText-Independent Speaker Recognition

VibE-SVC: Vibrato Extraction with High-frequency F0 Contour for Singing Voice Conversion

2025-05-27 · Joon-Seung Choi, Dong-Min Byun, Hyung-Seok Oh, Seong-Whan Lee

Controlling singing style is crucial for achieving an expressive and natural singing voice. Among the various style factors, vibrato plays a key role in conveying emotions and enhancing musical depth. However, modeling v…

Voice Conversion

Singing voice conversion with non-parallel data

2019-03-11 · Xin Chen, Wei Chu, Jinxi Guo, Ning Xu

Singing voice conversion is a task to convert a song sang by a source singer to the voice of a target singer. In this paper, we propose using a parallel data free, many-to-one voice conversion technique on singing voices…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1