홈 › Papers

BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacoustics

2024-03-15 · Lukas Rauch, Raphael Schwinger, Moritz Wirth, René Heinrich, Denis Huseljic, Marek Herde, Jonas Lange, Stefan Kahl, Bernhard Sick, Sven Tomforde, Christoph Scholz

Deep learning (DL) has greatly advanced audio classification, yet the field is limited by the scarcity of large-scale benchmark datasets that have propelled progress in other domains. While AudioSet is a pivotal step to bridge this gap as a universal-domain dataset, its restricted accessibility and limited range of evaluation use cases challenge its role as the sole resource. Therefore, we introduce BirdSet, a large-scale benchmark dataset for audio classification focusing on avian bioacoustics. BirdSet surpasses AudioSet with over 6,800 recording hours ($\uparrow\!17\%$) from nearly 10,000 classes ($\uparrow\!18\times$) for training and more than 400 hours ($\uparrow\!7\times$) across eight strongly labeled evaluation datasets. It serves as a versatile resource for use cases such as multi-label classification, covariate shift or self-supervised learning. We benchmark six well-known DL models in multi-label classification across three distinct training scenarios and outline further evaluation use cases in audio classification. We host our dataset on Hugging Face for easy accessibility and offer an extensive codebase to reproduce our results.

📄 PDF Abstract BibTeX arXiv:2403.10380

Code (1)

dbd-research-group/birdset 공식 구현 pytorch

Tasks

Audio Classification Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Self-Supervised Learning

Methods 이 논문이 사용한 방법론

Fragmentation Given a pattern $P,$ that is more complicated than the patterns, we fragment $P$ into simpler patterns such that their exact count is known. In the subgraph GNN proposed earlier,…

Can Masked Autoencoders Also Listen to Birds?

2025-04-17 · Lukas Rauch, René Heinrich, Ilyass Moummad, Alexis Joly 외

Masked Autoencoders (MAEs) have shown competitive results in audio classification by learning rich semantic representations through an efficient self-supervised reconstruction task. However, general-purpose models fail t…

Audio Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Self-Supervised Learning+1

Foundation Models for Bioacoustics -- a Comparative Review

2025-08-02 · Raphael Schwinger, Paria Vali Zadeh, Lukas Rauch, Mats Kurz 외 arxiv

Automated bioacoustic analysis is essential for biodiversity monitoring and conservation, requiring advanced deep learning models that can adapt to diverse bioacoustic tasks. This article presents a comprehensive review …

Self-Supervised Learning Representation Learning

AudioProtoPNet: An interpretable deep learning model for bird sound classification

2024-04-16 · René Heinrich, Lukas Rauch, Bernhard Sick, Christoph Scholz

Deep learning models have significantly advanced acoustic bird monitoring by being able to recognize numerous bird species based on their vocalizations. However, traditional deep learning models are black boxes that prov…

Audio Classification Classification Decision Making Deep Learning+2

Uncertainty Calibration of Multi-Label Bird Sound Classifiers

2025-11-11 · Raphael Schwinger, Ben McEwen, Vincent S. Kather, René Heinrich 외 arxiv

Passive acoustic monitoring enables large-scale biodiversity assessment, but reliable classification of bioacoustic sounds requires not only high accuracy but also well-calibrated uncertainty estimates to ground decision…

Multi-layer attentive probing improves transfer of audio representations for bioacoustics

2026-05-11 · Marius Miron, David Robinson, Masato Hagiwara, Titouan Parcollet 외 arxiv

Probing heads map the representations learned from audio by a machine learning model to downstream task labels and are a key component in evaluating representation learning. Most bioacoustic benchmarks use a fixed, low-c…

Representation Learning