Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement

2025-01-23 · Jae-Sung Bae, Anastasia Kuznetsova, Dinesh Manocha, John Hershey, Trausti Kristjansson, Minje Kim

This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation workshop at ICASSP 2025. Collecting high-quality personalized data is challenging due to privacy concerns and technical difficulties in recording audio from the test scene. To address these issues, synthetic data generation using generative models has gained significant attention. In this challenge, participants are tasked first with building zero-shot TTS systems to augment personalized data. Subsequently, PSE systems are asked to be trained with this augmented personalized dataset. Through this challenge, we aim to investigate how the quality of augmented data generated by zero-shot TTS models affects PSE model performance. We also provide baseline experiments using open-source zero-shot TTS models to encourage participation and benchmark advancements. Our baseline code implementation and checkpoints are available online.

📄 PDF Abstract BibTeX arXiv:2501.13372

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation Speech Enhancement Speech Synthesis Synthetic Data Generation text-to-speech Text to Speech

Text-guided Synthetic Geometric Augmentation for Zero-shot 3D Understanding

2025-01-16 · Kohei Torimi, Ryosuke Yamada, Daichi Otsuka, Kensho Hara 외

Zero-shot recognition models require extensive training data for generalization. However, in zero-shot 3D classification, collecting 3D data and captions is costly and laborintensive, posing a significant barrier compare…

3D Classification Zero-shot 3D classification Zero-Shot Learning

Generate then Refine: Data Augmentation for Zero-shot Intent Detection

2024-10-02 · I-Fan Lin, Faegheh Hasibi, Suzan Verberne

In this short paper we propose a data augmentation method for intent detection in zero-resource domains. Existing data augmentation methods rely on few labelled examples for each intent category, which can be expensive i…

Data Augmentation Diversity Intent Detection Language Modeling+2

Demonstration Augmentation for Zero-shot In-context Learning

2024-06-03 · Yi Su, Yunpeng Tai, Yixin Ji, Juntao Li 외

Large Language Models (LLMs) have demonstrated an impressive capability known as In-context Learning (ICL), which enables them to acquire knowledge from textual demonstrations without the need for parameter updates. Howe…

In-Context Learning

Leveraging QA Datasets to Improve Generative Data Augmentation

2022-05-25 · Dheeraj Mekala, Tu Vu, Timo Schick, Jingbo Shang

The ability of generative language models (GLMs) to generate text has improved considerably in the last few years, enabling their use for generative data augmentation. In this work, we propose CONDA, an approach to furth…

Common Sense Reasoning Data Augmentation Question Answering SST-2+1

How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval

2023-02-15 · Sheng-Chieh Lin, Akari Asai, Minghan Li, Barlas Oguz 외

Various techniques have been developed in recent years to improve dense retrieval (DR), such as unsupervised contrastive learning and pseudo-query generation. Existing DRs, however, often suffer from effectiveness tradeo…

Contrastive Learning Data Augmentation Passage Retrieval Retrieval+1