paper-with-me

홈 › Papers

Mixat: A Data Set of Bilingual Emirati-English Speech

2024-05-04 · Maryam Al Ali, Hanan Aldarmaki

This paper introduces Mixat: a dataset of Emirati speech code-mixed with English. Mixat was developed to address the shortcomings of current speech recognition resources when applied to Emirati speech, and in particular, to bilignual Emirati speakers who often mix and switch between their local dialect and English. The data set consists of 15 hours of speech derived from two public podcasts featuring native Emirati speakers, one of which is in the form of conversations between the host and a guest. Therefore, the collection contains examples of Emirati-English code-switching in both formal and natural conversational contexts. In this paper, we describe the process of data collection and annotation, and describe some of the features and statistics of the resulting data set. In addition, we evaluate the performance of pre-trained Arabic and multi-lingual ASR systems on our dataset, demonstrating the shortcomings of existing models on this low-resource dialectal Arabic, and the additional challenge of recognizing code-switching in ASR. The dataset will be made publicly available for research use.

📄 PDF Abstract BibTeX arXiv:2405.02578

Code (1)

mbzuai-nlp/mixat 공식 구현

Tasks

speech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion

2020-10-16 · Shengkui Zhao, Trung Hieu Nguyen, Hao Wang, Bin Ma

Recent state-of-the-art neural text-to-speech (TTS) synthesis models have dramatically improved intelligibility and naturalness of generated speech from text. However, building a good bilingual or code-switched TTS for a…

Speech Synthesistext-to-speechText to SpeechVoice Conversion

Non-native English lexicon creation for bilingual speech synthesis

2021-06-21 · Arun Baby, Pranav Jawale, Saranya Vinnaitherthan, Sumukh Badam 외

Bilingual English speakers speak English as one of their languages. Their English is of a non-native kind, and their conversations are of a code-mixed fashion. The intelligibility of a bilingual text-to-speech (TTS) syst…

Speech Synthesistext-to-speechText to Speech

Novel Dual-Channel Long Short-Term Memory Compressed Capsule Networks for Emotion Recognition

2021-12-26 · Ismail Shahin, Noor Hindawi, Ali Bou Nassif, Adi Alhudhaif 외

Recent analysis on speech emotion recognition has made considerable advances with the use of MFCCs spectrogram features and the implementation of neural network approaches such as convolutional neural networks (CNNs). Ca…

Emotion RecognitionSpeech Emotion Recognition

SpiCE: A New Open-Access Corpus of Conversational Bilingual Speech in Cantonese and English

2020-05-01 · LREC 2020 5 · Khia A. Johnson, Molly Babel, Ivan Fong, Nancy Yiu

This paper describes the design, collection, orthographic transcription, and phonetic annotation of SpiCE, a new corpus of conversational Cantonese-English bilingual speech recorded in Vancouver, Canada. The corpus inclu…

SentenceSpeech-to-Text

Speaker Identification from emotional and noisy speech data using learned voice segregation and Speech VGG

2022-10-23 · Shibani Hamsa, Ismail Shahin, Youssef Iraqi, Ernesto Damiani 외

Speech signals are subjected to more acoustic interference and emotional factors than other signals. Noisy emotion-riddled speech data is a challenge for real-time speech processing applications. It is essential to find …

Speaker Identification