Low-complexity deep learning frameworks for acoustic scene classification using teacher-student scheme and multiple spectrograms

2023-05-16 · Lam Pham, Dat Ngo, Cam Le, Anahid Jalali, Alexander Schindler

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) training a student network using distilled knowledge from the teacher. In the first phase, the teacher, which presents a large footprint model, is trained. After training the teacher, the embeddings, which are the feature map of the second last layer of the teacher, are extracted. In the second phase, the student network, which presents a low complexity model, is trained with the embeddings extracted from the teacher. Our experiments conducted on DCASE 2023 Task 1 Development dataset have fulfilled the requirement of low-complexity and achieved the best classification accuracy of 57.4%, improving DCASE baseline by 14.5%.

📄 PDF Abstract BibTeX arXiv:2305.09463

Code (0)

등록된 구현이 없습니다.

Tasks

Acoustic Scene Classification Scene Classification

Low-complexity deep learning frameworks for acoustic scene classification

2022-06-13 · Lam Pham, Dat Ngo, Anahid Jalali, Alexander Schindler

In this report, we presents low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed frameworks can be separated into four main steps: Front-end spectrogram extraction, online data au…

Acoustic Scene Classification Classification Data Augmentation Deep Learning+1

Creating a Good Teacher for Knowledge Distillation in Acoustic Scene Classification

2025-03-14 · Tobias Morocutti, Florian Schmid, Khaled Koutini, Gerhard Widmer

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in building well-performing low-complexity …

Acoustic Scene Classification Knowledge Distillation Scene Classification

Adaptive Knowledge Distillation using a Device-Aware Teacher for Low-Complexity Acoustic Scene Classification

2025-09-11 · Seung Gyu Jeong, Seong Eun Kim arxiv

In this technical report, we describe our submission for Task 1, Low-Complexity Device-Robust Acoustic Scene Classification, of the DCASE 2025 Challenge. Our work tackles the dual challenges of strict complexity constrai…

Acoustic Scene Classification Knowledge Distillation

Data Efficient Acoustic Scene Classification using Teacher-Informed Confusing Class Instruction

2024-09-18 · Jin Jie Sean Yeo, Ee-Leng Tan, Jisheng Bai, Santi Peksi 외

In this technical report, we describe the SNTL-NTU team's submission for Task 1 Data-Efficient Low-Complexity Acoustic Scene Classification of the detection and classification of acoustic scenes and events (DCASE) 2024 c…

Acoustic Scene Classification Data Augmentation Diversity Knowledge Distillation+1

Relational Teacher Student Learning with Neural Label Embedding for Device Adaptation in Acoustic Scene Classification

2020-07-31 · Hu Hu, Sabato Marco Siniscalchi, Yannan Wang, Chin-Hui Lee

In this paper, we propose a domain adaptation framework to address the device mismatch issue in acoustic scene classification leveraging upon neural label embedding (NLE) and relational teacher student learning (RTSL). T…

Acoustic Scene Classification Classification Domain Adaptation General Classification+1