Lombard Effect for Bilingual Speakers in Cantonese and English: importance of spectro-temporal features

2022-04-14 · Maximilian Karl Scharf, Sabine Hochmuth, Lena L. N. Wong, Birger Kollmeier, Anna Warzybok

For a better understanding of the mechanisms underlying speech perception and the contribution of different signal features, computational models of speech recognition have a long tradition in hearing research. Due to the diverse range of situations in which speech needs to be recognized, these models need to be generalizable across many acoustic conditions, speakers, and languages. This contribution examines the importance of different features for speech recognition predictions of plain and Lombard speech for English in comparison to Cantonese in stationary and modulated noise. While Cantonese is a tonal language that encodes information in spectro-temporal features, the Lombard effect is known to be associated with spectral changes in the speech signal. These contrasting properties of tonal languages and the Lombard effect form an interesting basis for the assessment of speech recognition models. Here, an automatic speech recognition-based ASR model using spectral or spectro-temporal features is evaluated with empirical data. The results indicate that spectro-temporal features are crucial in order to predict the speaker-specific speech recognition threshold SRT$_{50}$ in both Cantonese and English as well as to account for the improvement of speech recognition in modulated noise, while effects due to Lombard speech can already be predicted by spectral features.

📄 PDF Abstract BibTeX arXiv:2204.06907

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition Speech Recognition

SpiCE: A New Open-Access Corpus of Conversational Bilingual Speech in Cantonese and English

2020-05-01 · LREC 2020 5 · Khia A. Johnson, Molly Babel, Ivan Fong, Nancy Yiu

This paper describes the design, collection, orthographic transcription, and phonetic annotation of SpiCE, a new corpus of conversational Cantonese-English bilingual speech recorded in Vancouver, Canada. The corpus inclu…

Sentence Speech-to-Text

Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models

2025-03-05 · Jiyue Jiang, Alfred Kar Yin Truong, Yanyu Chen, Qinghang Bao 외

High-quality data resources play a crucial role in learning large language models (LLMs), particularly for low-resource languages like Cantonese. Despite having more than 85 million native speakers, Cantonese is still co…

Non-native English lexicon creation for bilingual speech synthesis

2021-06-21 · Arun Baby, Pranav Jawale, Saranya Vinnaitherthan, Sumukh Badam 외

Bilingual English speakers speak English as one of their languages. Their English is of a non-native kind, and their conversations are of a code-mixed fashion. The intelligibility of a bilingual text-to-speech (TTS) syst…

Speech Synthesis text-to-speech Text to Speech

What is India speaking: The "Hinglish" invasion

2014-06-12 · Rana D. Parshad, Vineeta Chand, Neha Sinha, Nitu Kumari

While language competition models of diachronic language shift are increasingly sophisticated, drawing on sociolinguistic components like variable language prestige, distance from language centers and intermediate biling…

Generating Multilingual Voices Using Speaker Space Translation Based on Bilingual Speaker Data

2020-04-10 · Soumi Maiti, Erik Marchi, Alistair Conkie

We present progress towards bilingual Text-to-Speech which is able to transform a monolingual voice to speak a second language while preserving speaker voice quality. We demonstrate that a bilingual speaker embedding spa…

text-to-speech Text to Speech Translation