Automatic Contextual Audio Denoising
Audio context determines which sound components and sources are relevant and which can be perceived as irrelevant (noise) by listeners. For example, traffic noise is informative in urban surveillance but noise for a phone call at the same location. Most current audio denoising systems apply fixed target-noise definitions, often removing useful components in one context while failing to suppress irrelevant components. To address this, we introduce the concept automatic contextual audio denoising (ACAD) which defines target and noise based on the inferred context. In this work, we restrict context to be associated with an acoustic scene class. We label sound events outside the event distribution of a scene class (noise) as out-of-context (OC) and events typical for that scene as in-context (IC). We implement a deep learning method that automatically infers the context of the audio signal and removes OC components, and benchmark it against variants: without context inference, with oracle context, and with separately provided uninformative context. On paired clean/noisy data across diverse contexts, where OC components in one context may be IC in another, our proposed method outperforms other approaches across standard objective metrics, indicating that the model can infer context and context-dependent processing can enhance denoising.
Code (0)
등록된 구현이 없습니다.
Tasks
Audio DenoisingSimilar Papers 제목 키워드 기반
Listening to Sounds of Silence for Speech Denoising
We introduce a deep learning model for speech denoising, a long-standing challenge in audio analysis arising in numerous applications. Our approach is based on a key observation about human speech: there is often a short…
DenoisingSentenceSpeech DenoisingATIR: Towards Audio-Text Interleaved Contextual Retrieval
Audio carries richer information than text, including emotion, speaker traits, and environmental context, while also enabling lower-latency processing compared to speech-to-text pipelines. However, recent multimodal info…
Information RetrievalSemantic RetrievalSpeech RecognitionBirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds
Audio denoising has been explored for decades using both traditional and deep learning-based methods. However, these methods are still limited to either manually added artificial noise or lower denoised audio quality. To…
Audio DenoisingDenoisingImage SegmentationNoise Estimation+2PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models
Denoising diffusion models have emerged as state-of-the-art in generative tasks across image, audio, and video domains, producing high-quality, diverse, and contextually relevant data. However, their broader adoption is …
Audio GenerationAudio SynthesisDenoisingQuantizationEnhancing Large Language Model-based Speech Recognition by Contextualization for Rare and Ambiguous Words
We develop a large language model (LLM) based automatic speech recognition (ASR) system that can be contextualized by providing keywords as prior information in text prompts. We adopt decoder-only architecture and use ou…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderLanguage Modeling+4