Decoupling entrainment from consistency using deep neural networks
Human interlocutors tend to engage in adaptive behavior known as entrainment to become more similar to each other. Isolating the effect of consistency, i.e., speakers adhering to their individual styles, is a critical part of the analysis of entrainment. We propose to treat speakers' initial vocal features as confounds for the prediction of subsequent outputs. Using two existing neural approaches to deconfounding, we define new measures of entrainment that control for consistency. These successfully discriminate real interactions from fake ones. Interestingly, our stricter methods correlate with social variables in opposite direction from previous measures that do not account for consistency. These results demonstrate the advantages of using neural networks to model entrainment, and raise questions regarding how to interpret prior associations of conversation quality with entrainment measures that do not account for consistency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
LEEETs-Dial: Linguistic Entrainment in End-to-End Task-oriented Dialogue systems
Linguistic entrainment, or alignment, represents a phenomenon where linguistic patterns employed by conversational participants converge to one another. While entrainment has been shown to produce a more natural user exp…
Task-Oriented Dialogue SystemsLooking for Structure in Lexical and Acoustic-Prosodic Entrainment Behaviors
Entrainment has been shown to occur for various linguistic features individually. Motivated by cognitive theories regarding linguistic entrainment, we analyze speakers{'} overall entrainment behaviors and search for an u…
Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue
Entrainment is the phenomenon by which an interlocutor adapts their speaking style to align with their partner in conversations. It has been found in different dimensions as acoustic, prosodic, lexical or syntactic. In t…
Spoken Dialogue Systemstext-to-speechText to SpeechLlama See, Llama Do: A Mechanistic Perspective on Contextual Entrainment and Distraction in LLMs
We observe a novel phenomenon, contextual entrainment, across a wide range of language models (LMs) and prompt settings, providing a new mechanistic perspective on how LMs become distracted by ``irrelevant'' contextual i…
counterfactualLanguage Proficiency and F0 Entrainment: A Study of L2 English Imitation in Italian, French, and Slovak Speakers
This study explores F0 entrainment in second language (L2) English speech imitation during an Alternating Reading Task (ART). Participants with Italian, French, and Slovak native languages imitated English utterances, an…
Dynamic Time Warping