paper-with-me

Papers

Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages

2026-04-20 · V. S. D. S. Mahesh Akavarapu, Michael Daniel, Gerhard Jäger arxiv

We present a phoneme-level analysis of automatic speech recognition (ASR) for two low-resourced and phonologically complex East Caucasian languages, Archi and Rutul, based on curated and standardized speech-transcript resources totaling approximately 50 minutes and 1 hour 20 minutes of audio, respectively. Existing recordings and transcriptions are consolidated and processed into a form suitable for ASR training and evaluation. We evaluate several state-of-the-art audio and audio-language models, including wav2vec2, Whisper, and Qwen2-Audio. For wav2vec2, we introduce a language-specific phoneme vocabulary with heuristic output-layer initialization, which yields consistent improvements and achieves performance comparable to or exceeding Whisper in these extremely low-resource settings. Beyond standard word and character error rates, we conduct a detailed phoneme-level error analysis. We find that phoneme recognition accuracy strongly correlates with training frequency, exhibiting a characteristic sigmoid-shaped learning curve. For Archi, this relationship partially breaks for Whisper, pointing to model-specific generalization effects beyond what is predicted by training frequency. Overall, our results indicate that many errors attributed to phonological complexity are better explained by data scarcity. These findings demonstrate the value of phoneme-level evaluation for understanding ASR behavior in low-resource, typologically complex languages.

📄 PDF Abstract BibTeX arXiv:2604.18204

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Recognition

Similar Papers 제목 키워드 기반

Train & Constrain: Phonologically Informed Tongue-Twister Generation from Topics and Paraphrases

2024-03-20 · Tyler Loakman, Chen Tang, Chenghua Lin

Previous work in phonologically and phonetically grounded language generation has mainly focused on domains such as puns and poetry. In this article, we present new work on the generation of English tongue twisters - a f…

Language ModelingLanguage ModellingText Generation

Phoneme- and Word-Level Metrics Using Self-Supervised Speech Representations for Forced Alignment Evaluation

2026-08-28 · V. S. D. S. Mahesh Akavarapu, Michael Daniel, Gerhard Jäger arxiv

Forced alignment evaluation typically requires manually annotated timestamps, limiting large-scale and multilingual analysis. We introduce two corpus-level metrics based on self-supervised (SSL) speech representations fo…

Multilingual Phonological Feature Recognition with Self-Supervised Speech Models

2026-05-25 · Abner Hernandez, Tomás Arias-Vergara, Daiqi Liu, Andreas Maier 외 arxiv

Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech mod…

Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysis

2025-01-12 · Minu Kim, Kangwook Jang, Hoirin Kim

This paper examines how linguistic similarity affects cross-lingual phonetic representation in speech processing for low-resource languages, emphasizing effective source language selection. Previous cross-lingual researc…

Phoneme RecognitionSelf-Supervised Learning

From Phonology to Syntax: Unsupervised Linguistic Typology at Different Levels with Language Embeddings

2018-02-23 · NAACL 2018 6 · Johannes Bjerva, Isabelle Augenstein

A core part of linguistic typology is the classification of languages according to linguistic properties, such as those detailed in the World Atlas of Language Structure (WALS). Doing this manually is prohibitively time-…

Morphological InflectionPart-Of-Speech Tagging