paper-with-me

홈 › Papers

Code-switching in text and speech reveals information-theoretic audience design

2024-08-08 · Debasmita Bhattacharya, Marten Van Schijndel

In this work, we use language modeling to investigate the factors that influence code-switching. Code-switching occurs when a speaker alternates between one language variety (the primary language) and another (the secondary language), and is widely observed in multilingual contexts. Recent work has shown that code-switching is often correlated with areas of high information load in the primary language, but it is unclear whether high primary language load only makes the secondary language relatively easier to produce at code-switching points (speaker-driven code-switching), or whether code-switching is additionally used by speakers to signal the need for greater attention on the part of listeners (audience-driven code-switching). In this paper, we use bilingual Chinese-English online forum posts and transcripts of spontaneous Chinese-English speech to replicate prior findings that high primary language (Chinese) information load is correlated with switches to the secondary language (English). We then demonstrate that the information load of the English productions is even higher than that of meaning equivalent Chinese alternatives, and these are therefore not easier to produce, providing evidence of audience-driven influences in code-switching at the level of the communication channel, not just at the sociolinguistic level, in both writing and speech.

📄 PDF Abstract BibTeX arXiv:2408.04596

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Improving Code-switched ASR with Linguistic Information

2022-10-01 · COLING 2022 10 · Jie Chi, Peter Bell

This paper seeks to improve the performance of automatic speech recognition (ASR) systems operating on code-switched speech. Code-switching refers to the alternation of languages within a conversation, a phenomenon that …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Modellingspeech-recognition+2

A Mandarin-English Code-Switching Corpus

2012-05-01 · LREC 2012 5 · Ying Li, Yue Yu, Pascale Fung

Generally the existing monolingual corpora are not suitable for large vocabulary continuous speech recognition (LVCSR) of code-switching speech. The motivation of this paper is to study the rules and constraints code-swi…

Boundary DetectionLanguage IdentificationPOSSentence+2

Hindi-English Code-Switching Speech Corpus

2018-09-24 · Sreeram Ganji, Dhawan Kunal, Sinha Rohit

Code-switching refers to the usage of two languages within a sentence or discourse. It is a global phenomenon among multilingual communities and has emerged as an independent area of research. With the increasing demand …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language IdentificationLanguage Modeling+5

Non-autoregressive Mandarin-English Code-switching Speech Recognition

2021-04-06 · Shun-Po Chuang, Heng-Jui Chang, Sung-Feng Huang, Hung-Yi Lee

Mandarin-English code-switching (CS) is frequently used among East and Southeast Asian people. However, the intra-sentence language switching of the two very different languages makes recognizing CS speech challenging. M…

DecoderSentencespeech-recognitionSpeech Recognition

Code-Switching Text Generation and Injection in Mandarin-English ASR

2023-03-20 · Haibin Yu, Yuxuan Hu, Yao Qian, Ma Jin 외

Code-switching speech refers to a means of expression by mixing two or more languages within a single utterance. Automatic Speech Recognition (ASR) with End-to-End (E2E) modeling for such speech can be a challenging task…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+3