paper-with-me

홈 › Papers

A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settings

2026-07-28 · Debasmita Bhattacharya, Siying Ding, Alayna Nguyen, Julia Hirschberg arxiv

Conversational entrainment is well-studied in monolingual and written contexts, but remains underexplored in spoken code-switching (CSW). We present a novel cross-lingual analysis of entrainment in Mandarin-English, Hindi-English, and Spanish-English dialogue and show that, while lexical entrainment generalizes across language pairs, entrainment over acoustic-prosodic and CSW style aspects exhibits context-specific variation. We build on these findings by asking whether classification models capture these human behavioral patterns. Applying feature importance and ablation analyses, we find that classical and Transformer-based classifiers detect entrainment reasonably well but consistently prioritize features other than those most salient to human entraining behavior. Our approach introduces a human-grounded framework for evaluating model decision-making in multilingual stylistic contexts, and suggests future challenges for developing conversational agents capable of producing naturalistic code-switched speech.

📄 PDF Abstract BibTeX arXiv:2607.25202

Code (3)

NickDee96/ASR-TTS-paper-daily ★ 7
Tavish9/awesome-daily-AI-arxiv ★ 112
arxivsub/arXivSub_daily_arxiv ★ 4

Tasks

Feature Importance

Similar Papers 제목 키워드 기반

Measuring Entrainment in Spontaneous Code-switched Speech

2023-11-13 · Debasmita Bhattacharya, Siying Ding, Alayna Nguyen, Julia Hirschberg

It is well-known that speakers who entrain to one another have more successful conversations than those who do not. Previous research has shown that interlocutors entrain on linguistic features in both written and spoken…

A Context-Aware Computational Approach for Measuring Vocal Entrainment in Dyadic Conversations

2022-11-07 · Rimita Lahiri, Md Nasir, Catherine Lord, So Hyun Kim 외

Vocal entrainment is a social adaptation mechanism in human interaction, knowledge of which can offer useful insights to an individual's cognitive-behavioral characteristics. We propose a context-aware approach for measu…

Entrainment profiles: Comparison by gender, role, and feature set

2018-05-29 · Uwe D. Reichel, Štefan Beňuš, Katalin Mády

We examine prosodic entrainment in cooperative game dialogs for new feature sets describing register, pitch accent shape, and rhythmic aspects of utterances. For these as well as for established features we present entra…

Acoustic-prosodic entrainment in Slovak, Spanish, English and Chinese: A cross-linguistic comparison

2015-09-01 · WS 2015 9 · Rivka Levitan, {\v{S}}tefan Be{\v{n}}u{\v{s}}, Agust{\'\i}n Gravano, Julia Hirschberg

Understanding Entrainment in Human Groups: Optimising Human-Robot Collaboration from Lessons Learned during Human-Human Collaboration

2024-02-23 · Eike Schneiders, Christopher Fourie, Stanley Celestin, Julie Shah 외

Successful entrainment during collaboration positively affects trust, willingness to collaborate, and likeability towards collaborators. In this paper, we present a mixed-method study to investigate characteristics of su…