Data Efficient Acoustic Scene Classification using Teacher-Informed Confusing Class Instruction

2024-09-18 · Jin Jie Sean Yeo, Ee-Leng Tan, Jisheng Bai, Santi Peksi, Woon-Seng Gan

In this technical report, we describe the SNTL-NTU team's submission for Task 1 Data-Efficient Low-Complexity Acoustic Scene Classification of the detection and classification of acoustic scenes and events (DCASE) 2024 challenge. Three systems are introduced to tackle training splits of different sizes. For small training splits, we explored reducing the complexity of the provided baseline model by reducing the number of base channels. We introduce data augmentation in the form of mixup to increase the diversity of training samples. For the larger training splits, we use FocusNet to provide confusing class information to an ensemble of multiple Patchout faSt Spectrogram Transformer (PaSST) models and baseline models trained on the original sampling rate of 44.1 kHz. We use Knowledge Distillation to distill the ensemble model to the baseline student model. Training the systems on the TAU Urban Acoustic Scene 2022 Mobile development dataset yielded the highest average testing accuracy of (62.21, 59.82, 56.81, 53.03, 47.97)% on split (100, 50, 25, 10, 5)% respectively over the three systems.

📄 PDF Abstract BibTeX arXiv:2409.11964

Code (0)

등록된 구현이 없습니다.

Tasks

Acoustic Scene Classification Data AugmentationDiversityKnowledge Distillation Scene Classification

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Multi-Head Attention 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Relational Teacher Student Learning with Neural Label Embedding for Device Adaptation in Acoustic Scene Classification

2020-07-31 · Hu Hu, Sabato Marco Siniscalchi, Yannan Wang, Chin-Hui Lee

In this paper, we propose a domain adaptation framework to address the device mismatch issue in acoustic scene classification leveraging upon neural label embedding (NLE) and relational teacher student learning (RTSL). T…

Acoustic Scene Classification Classification Domain Adaptation General Classification+1

Low-complexity deep learning frameworks for acoustic scene classification using teacher-student scheme and multiple spectrograms

2023-05-16 · Lam Pham, Dat Ngo, Cam Le, Anahid Jalali 외

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) tr…

Acoustic Scene Classification Scene Classification

Cross-task pre-training for on-device acoustic scene classification

2019-10-22 · Ruixiong Zhang, Wei Zou, Xiangang Li

Acoustic scene classification (ASC) and acoustic event detection (AED) are different but related tasks. Acoustic events can provide useful information for recognizing acoustic scenes. However, most of the datasets are pr…

Acoustic Scene Classification Classification Event Detection General Classification+1

Creating a Good Teacher for Knowledge Distillation in Acoustic Scene Classification

2025-03-14 · Tobias Morocutti, Florian Schmid, Khaled Koutini, Gerhard Widmer

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in building well-performing low-complexity …

Acoustic Scene Classification Knowledge Distillation Scene Classification

Adaptive Knowledge Distillation using a Device-Aware Teacher for Low-Complexity Acoustic Scene Classification

2025-09-11 · Seung Gyu Jeong, Seong Eun Kim arxiv

In this technical report, we describe our submission for Task 1, Low-Complexity Device-Robust Acoustic Scene Classification, of the DCASE 2025 Challenge. Our work tackles the dual challenges of strict complexity constrai…

Acoustic Scene Classification Knowledge Distillation