paper-with-me

홈 › Papers

DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection

2026-01-01 · Yuxin Li, Xiangyu Zhang, Yifei Li, Zhiwei Guo, Haoyang Zhang, Eng Siong Chng, Cuntai Guan arxiv

Speech is a scalable and non-invasive biomarker for early mental health screening. However, widely used depression datasets like DAIC-WOZ exhibit strong coupling between linguistic sentiment and diagnostic labels, encouraging models to learn semantic shortcuts. As a result, model robustness may be compromised in real-world scenarios, such as Camouflaged Depression, where individuals maintain socially positive or neutral language despite underlying depressive states. To mitigate this semantic bias, we propose DepFlow, a three-stage depression-conditioned text-to-speech framework. First, a Depression Acoustic Encoder learns speaker- and content-invariant depression embeddings through adversarial training, achieving effective disentanglement while preserving depression discriminability (ROC-AUC: 0.693). Second, a flow-matching TTS model with FiLM modulation injects these embeddings into synthesis, enabling control over depressive severity while preserving content and speaker identity. Third, a prototype-based severity mapping mechanism provides smooth and interpretable manipulation across the depression continuum. Using DepFlow, we construct a Camouflage Depression-oriented Augmentation (CDoA) dataset that pairs depressed acoustic patterns with positive/neutral content from a sentiment-stratified text bank, creating acoustic-semantic mismatches underrepresented in natural data. Evaluated across three depression detection architectures, CDoA improves macro-F1 by 9%, 12%, and 5%, respectively, consistently outperforming conventional augmentation strategies in depression Detection. Beyond enhancing robustness, DepFlow provides a controllable synthesis platform for conversational systems and simulation-based evaluation, where real clinical data remains limited by ethical and coverage constraints.

📄 PDF Abstract BibTeX arXiv:2601.00303

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

2018-07-20 · Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo 외

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech. This is a challenging task because face appearance variation and semantics of speech are coupled together in the s…

Face GenerationLip ReadingRetrievalTalking Face Generation+1

DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion

2026-01-14 · Hanlin Zhang, Daxin Tan, Dehua Tao, Xiao Chen 외 arxiv

Speech tokenizers are a key building block of fully discrete Speech LLMs. Existing tokenizers either prioritize semantic encoding, fuse semantic content with acoustic style inseparably, or achieve incomplete semantic-aco…

Universal Speech Token Learning via Low-Bitrate Neural Codec and Pretrained Representations

2025-03-15 · Xue Jiang, Xiulian Peng, Yuan Zhang, Yan Lu

Current large speech language models are mainly based on semantic tokens from discretization of self-supervised learned representations and acoustic tokens from a neural codec, following a semantic-modeling and acoustic-…

ParaMETA: Towards Learning Disentangled Paralinguistic Speaking Styles Representations from Speech

2026-01-18 · Haowei Lou, Hye-young Paik, Wen Hu, Lina Yao arxiv

Learning representative embeddings for different types of speaking styles, such as emotion, age, and gender, is critical for both recognition tasks (e.g., cognitive computing and human-computer interaction) and generativ…

Factorized RVQ-GAN For Disentangled Speech Tokenization

2025-06-18 · Sameer Khurana, Dominik Klement, Antoine Laurent, Dominik Bobos 외

We propose Hierarchical Audio Codec (HAC), a unified neural speech codec that factorizes its bottleneck into three linguistic levels-acoustic, phonetic, and lexical-within a single model. HAC leverages two knowledge dist…

DisentanglementKnowledge DistillationSpeech Tokenization