BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds
Audio denoising has been explored for decades using both traditional and deep learning-based methods. However, these methods are still limited to either manually added artificial noise or lower denoised audio quality. To overcome these challenges, we collect a large-scale natural noise bird sound dataset. We are the first to transfer the audio denoising problem into an image segmentation problem and propose a deep visual audio denoising (DVAD) model. With a total of 14,120 audio images, we develop an audio ImageMask tool and propose to use a few-shot generalization strategy to label these images. Extensive experimental results demonstrate that the proposed model achieves state-of-the-art performance. We also show that our method can be easily generalized to speech denoising, audio separation, audio enhancement, and noise estimation.
Code (1)
Tasks
Audio DenoisingDenoisingImage SegmentationNoise EstimationSemantic SegmentationSpeech DenoisingSimilar Papers 제목 키워드 기반
Unsupervised outlier detection to improve bird audio dataset labels
The Xeno-Canto bird audio repository is an invaluable resource for those interested in vocalizations and other sounds made by birds around the world. This is particularly the case for machine learning researchers attempt…
Dimensionality ReductionOutlier DetectionDynamic Multi-Species Bird Soundscape Generation with Acoustic Patterning and 3D Spatialization
Generation of dynamic, scalable multi-species bird soundscapes remains a significant challenge in computer music and algorithmic sound design. Birdsongs involve rapid frequency-modulated chirps, complex amplitude envelop…
Co-Separating Sounds of Visual Objects
Learning how objects sound from video is challenging, since they often heavily overlap in a single audio channel. Current methods for visually-guided audio source separation sidestep the issue by training with artificial…
Audio DenoisingAudio Source SeparationDenoisingLearning to Separate Object Sounds by Watching Unlabeled Video
Perceiving a scene most fully requires all the senses. Yet modeling how objects look and sound is challenging: most natural scenes and events contain multiple objects, and the audio track mixes all the sound sources toge…
Audio DenoisingAudio Source SeparationDenoisingMulti-Label LearningASGIR: Audio Spectrogram Transformer Guided Classification And Information Retrieval For Birds
Recognition and interpretation of bird vocalizations are pivotal in ornithological research and ecological conservation efforts due to their significance in understanding avian behaviour, performing habitat assessment an…
Information RetrievalRetrieval