paper-with-me

Papers

Foreground-Background Ambient Sound Scene Separation

2020-05-11 · Michel Olvera, Emmanuel Vincent, Romain Serizel, Gilles Gasso

Ambient sound scenes typically comprise multiple short events occurring on top of a somewhat stationary background. We consider the task of separating these events from the background, which we call foreground-background ambient sound scene separation. We propose a deep learning-based separation framework with a suitable feature normaliza-tion scheme and an optional auxiliary network capturing the background statistics, and we investigate its ability to handle the great variety of sound classes encountered in ambient sound scenes, which have often not been seen in training. To do so, we create single-channel foreground-background mixtures using isolated sounds from the DESED and Audioset datasets, and we conduct extensive experiments with mixtures of seen or unseen sound classes at various signal-to-noise ratios. Our experimental findings demonstrate the generalization ability of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2005.07006

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos

2024-06-13 · Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue 외

Generating realistic audio for human actions is important for many applications, such as creating sound effects for films or virtual reality games. Existing approaches implicitly assume total correspondence between the v…

Audio GenerationRetrieval-augmented Generation

Augmented Robust PCA For Foreground-Background Separation on Noisy, Moving Camera Video

2017-09-27 · Chen Gao, Brian E. Moore, Raj Rao Nadakuditi

This work presents a novel approach for robust PCA with total variation regularization for foreground-background separation and denoising on noisy, moving camera video. Our proposed algorithm registers the raw (possibly …

Denoising

Exploring Audio Hallucination in Egocentric Video Understanding

2026-04-26 · Ashish Seth, Xinhao Mei, Changsheng Zhao, Varun Nagaraja 외 arxiv

Egocentric videos provide a distinctive setting in which sound serves as crucial cues to understand user activities and surroundings, particularly when visual information is unstable or occluded due to continuous camera …

Approximated Robust Principal Component Analysis for Improved General Scene Background Subtraction

2016-03-18 · Salehe Erfanian Ebadi, Valia Guerra Ones, Ebroul Izquierdo

The research reported in this paper addresses the fundamental task of separation of locally moving or deforming image areas from a static or globally moving background. It builds on the latest developments in the field o…

Compressive Online Robust Principal Component Analysis with Optical Flow for Video Foreground-Background Separation

2017-10-25 · Srivatsa Prativadibhayankaram, Huynh Van Luong, Thanh-Ha Le, Andre Kaup

In the context of online Robust Principle Component Analysis (RPCA) for the video foreground-background separation, we propose a compressive online RPCA with optical flow that separates recursively a sequence of frames i…

Optical Flow Estimation