paper-with-me

Papers

Exploiting Spectral Augmentation for Code-Switched Spoken Language Identification

2020-10-14 · Pradeep Rangan, Sundeep Teki, Hemant Misra

Spoken language Identification (LID) systems are needed to identify the language(s) present in a given audio sample, and typically could be the first step in many speech processing related tasks such as automatic speech recognition (ASR). Automatic identification of the languages present in a speech signal is not only scientifically interesting, but also of practical importance in a multilingual country such as India. In many of the Indian cities, when people interact with each other, as many as three languages may get mixed. These may include the official language of that province, Hindi and English (at times the languages of the neighboring provinces may also get mixed during these interactions). This makes the spoken LID task extremely challenging in Indian context. While quite a few LID systems in the context of Indian languages have been implemented, most such systems have used small scale speech data collected internally within an organization. In the current work, we perform spoken LID on three Indian languages (Gujarati, Telugu, and Tamil) code-mixed with English. This task was organized by the Microsoft research team as a spoken LID challenge. In our work, we modify the usual spectral augmentation approach and propose a language mask that discriminates the language ID pairs, which leads to a noise robust spoken LID system. The proposed method gives a relative improvement of approximately 3-5% in the LID accuracy over a baseline system proposed by Microsoft on the three language pairs for two shared tasks suggested in the challenge.

📄 PDF Abstract BibTeX arXiv:2010.07130

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Identificationspeech-recognitionSpeech RecognitionSpoken language identification

Similar Papers 제목 키워드 기반

Adversarial synthesis based data-augmentation for code-switched spoken language identification

2022-05-30 · Parth Shastri, Chirag Patil, Poorval Wanere, Dr. Shrinivas Mahajan 외

Spoken Language Identification (LID) is an important sub-task of Automatic Speech Recognition(ASR) that is used to classify the language(s) in an audio segment. Automatic LID plays an useful role in multilingual countrie…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationGenerative Adversarial Network+4

Measuring Entrainment in Spontaneous Code-switched Speech

2023-11-13 · Debasmita Bhattacharya, Siying Ding, Alayna Nguyen, Julia Hirschberg

It is well-known that speakers who entrain to one another have more successful conversations than those who do not. Previous research has shown that interlocutors entrain on linguistic features in both written and spoken…

Code-switched inspired losses for generic spoken dialog representations

2021-08-27 · Emile Chapuis, Pierre Colombo, Matthieu Labeau, Chloe Clavel

Spoken dialog systems need to be able to handle both multiple languages and multilinguality inside a conversation (\textit{e.g} in case of code-switching). In this work, we introduce new pretraining losses tailored to le…

Retrieval

CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving

2024-06-16 · Bhavani Shankar, Preethi Jyothi, Pushpak Bhattacharyya

Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this wor…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+3

CST5: Data Augmentation for Code-Switched Semantic Parsing

2022-11-14 · Anmol Agarwal, Jigar Gupta, Rahul Goel, Shyam Upadhyay 외

Extending semantic parsers to code-switched input has been a challenging problem, primarily due to a lack of supervised training data. In this work, we introduce CST5, a new data augmentation technique that finetunes a T…

Data AugmentationSemantic Parsing