paper-with-me

Papers

Unified Pathological Speech Analysis with Prompt Tuning

2024-11-05 · Fei Yang, Xuenan Xu, Mengyue Wu, Kai Yu

Pathological speech analysis has been of interest in the detection of certain diseases like depression and Alzheimer's disease and attracts much interest from researchers. However, previous pathological speech analysis models are commonly designed for a specific disease while overlooking the connection between diseases, which may constrain performance and lower training efficiency. Instead of fine-tuning deep models for different tasks, prompt tuning is a much more efficient training paradigm. We thus propose a unified pathological speech analysis system for as many as three diseases with the prompt tuning technique. This system uses prompt tuning to adjust only a small part of the parameters to detect different diseases from speeches of possible patients. Our system leverages a pre-trained spoken language model and demonstrates strong performance across multiple disorders while only fine-tuning a fraction of the parameters. This efficient training approach leads to faster convergence and improved F1 scores by allowing knowledge to be shared across tasks. Our experiments on Alzheimer's disease, Depression, and Parkinson's disease show competitive results, highlighting the effectiveness of our method in pathological speech analysis.

📄 PDF Abstract BibTeX arXiv:2411.04142

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models

2024-06-07 · Malo Maisonneuve, Corinne Fredouille, Muriel Lalain, Alain Ghio 외

Head and Neck Cancers (HNC) significantly impact patients' ability to speak, affecting their quality of life. Commonly used metrics for assessing pathological speech are subjective, prompting the need for automated and u…

SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks

2023-03-01 · Kai-Wei Chang, Yu-Kai Wang, Hua Shen, Iu-thing Kang 외

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt tuning has demonstrated its storage and…

ClassificationLanguage ModelingLanguage ModellingSpoken Language Understanding

GRASS: Unified Generation Model for Speech-to-Semantic Tasks

2023-09-06 · Aobo Xia, Shuyu Lei, Yushu Yang, Xiang Guo 외

This paper explores the instruction fine-tuning technique for speech-to-semantic tasks by introducing a unified end-to-end (E2E) framework that generates target text conditioned on a task-related prompt for audio data. W…

named-entity-recognitionNamed Entity RecognitionQuestion AnsweringSentiment Analysis+2

Variational Autoencoder for Personalized Pathological Speech Enhancement

2025-03-18 · Mingchi Hou, Ina Kodrasi

The generalizability of speech enhancement (SE) models across speaker conditions remains largely unexplored, despite its critical importance for broader applicability. This paper investigates the performance of the hybri…

Speech Enhancement

SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts

2023-06-03 · Haibin Wu, Kai-Wei Chang, Yuan-Kuei Wu, Hung-Yi Lee

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLM…

Open-Ended Question Answering