paper-with-me

Papers

AdaCS: Adaptive Normalization for Enhanced Code-Switching ASR

2025-01-13 · The Chuong Chu, Vu Tuan Dat Pham, Kien Dao, Hoang Nguyen, Quoc Hung Truong

Intra-sentential code-switching (CS) refers to the alternation between languages that happens within a single utterance and is a significant challenge for Automatic Speech Recognition (ASR) systems. For example, when a Vietnamese speaker uses foreign proper names or specialized terms within their speech. ASR systems often struggle to accurately transcribe intra-sentential CS due to their training on monolingual data and the unpredictable nature of CS. This issue is even more pronounced for low-resource languages, where limited data availability hinders the development of robust models. In this study, we propose AdaCS, a normalization model integrates an adaptive bias attention module (BAM) into encoder-decoder network. This novel approach provides a robust solution to CS ASR in unseen domains, thereby significantly enhancing our contribution to the field. By utilizing BAM to both identify and normalize CS phrases, AdaCS enhances its adaptive capabilities with a biased list of words provided during inference. Our method demonstrates impressive performance and the ability to handle unseen CS phrases across various domains. Experiments show that AdaCS outperforms previous state-of-the-art method on Vietnamese CS ASR normalization by considerable WER reduction of 56.2% and 36.8% on the two proposed test sets.

📄 PDF Abstract BibTeX arXiv:2501.07102

Code (1)

adacs-project/adacs-project.github.io 공식 구현

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
BAM Park et al. proposed the bottleneck attention module (BAM), aiming to efficiently improve the representational capability of networks. It uses dilated convolution to enlarge…

Similar Papers 제목 키워드 기반

Adaptive Cost-Sensitive Learning in Neural Networks for Misclassification Cost Problems

2021-11-14 · Ohad Volk, Gonen Singer

We design a new adaptive learning algorithm for misclassification cost problems that attempt to reduce the cost of misclassified instances derived from the consequences of various errors. Our algorithm (adaptive cost sen…

Binary Classification

Universal Dependency Parsing for Hindi-English Code-switching

2018-04-16 · NAACL 2018 6 · Irshad Ahmad Bhat, Riyaz Ahmad Bhat, Manish Shrivastava, Dipti Misra Sharma

Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that …

Dependency ParsingLanguage IdentificationTAGTransliteration

Development of Mandarin-English code-switching speech synthesis system

2022-11-01 · ROCLING 2022 11 · Hsin-Jou Lien, Li-Yu Huang, Chia-Ping Chen

In this paper, the Mandarin-English code-switching speech synthesis system has been proposed. To focus on learning the content information between two languages, the training dataset is multilingual artificial dataset wh…

SentenceSpeech Synthesis

Bilingual Character Representation for Efficiently Addressing Out-of-Vocabulary Words in Code-Switching Named Entity Recognition

2018-05-30 · WS 2018 7 · Genta Indra Winata, Chien-Sheng Wu, Andrea Madotto, Pascale Fung

We propose an LSTM-based model with hierarchical architecture on named entity recognition from code-switching Twitter data. Our model uses bilingual character representation and transfer learning to address out-of-vocabu…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Transfer Learning

Expert-Driven Survival Machines: Improving Stratification and Interpretability in Multiple Clinical Cohorts

2026-06-12 · Farica Zhuang, Zixuan Wen, Christos Davatzikos, Li Shen arxiv

Survival prediction plays a central role for healthcare providers and clinical researchers. Accurate risk stratification enables early intervention and improved patient management. Most existing deep survival models lear…

Deep Clustering