paper-with-me

Papers

Relational Teacher Student Learning with Neural Label Embedding for Device Adaptation in Acoustic Scene Classification

2020-07-31 · Hu Hu, Sabato Marco Siniscalchi, Yannan Wang, Chin-Hui Lee

In this paper, we propose a domain adaptation framework to address the device mismatch issue in acoustic scene classification leveraging upon neural label embedding (NLE) and relational teacher student learning (RTSL). Taking into account the structural relationships between acoustic scene classes, our proposed framework captures such relationships which are intrinsically device-independent. In the training stage, transferable knowledge is condensed in NLE from the source domain. Next in the adaptation stage, a novel RTSL strategy is adopted to learn adapted target models without using paired source-target data often required in conventional teacher student learning. The proposed framework is evaluated on the DCASE 2018 Task1b data set. Experimental results based on AlexNet-L deep classification models confirm the effectiveness of our proposed approach for mismatch situations. NLE-alone adaptation compares favourably with the conventional device adaptation and teacher student based adaptation techniques. NLE with RTSL further improves the classification accuracy.

📄 PDF Abstract BibTeX arXiv:2008.00110

Code (0)

등록된 구현이 없습니다.

Tasks

Acoustic Scene ClassificationClassificationDomain AdaptationGeneral ClassificationScene Classification

Similar Papers 제목 키워드 기반

AMRD: Adaptive Multi-Teacher Relational Distillation for Lightweight Speech Emotion Recognition

2026-07-28 · Yuqi Li, Yi-Cheng Lin, Xianglong Wang, Kuo Yang 외 arxiv

On-device speech emotion recognition (SER) is critical for real-time applications, yet large self-supervised models that excel at SER are too costly for edge devices. Multi-teacher knowledge distillation can compress the…

Speech Emotion RecognitionKnowledge Distillation

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation

2026-03-26 · Jeannie Chung, Hanna Jang, Ingyeong Yang, Uiwon Hwang 외 arxiv

CLIP aligns image and text embeddings via contrastive learning and demonstrates strong zero-shot generalization. Its large-scale architecture requires substantial computational and memory resources, motivating the distil…

Zero-shot GeneralizationKnowledge DistillationContrastive Learning

Unified Knowledge Distillation Framework: Fine-Grained Alignment and Geometric Relationship Preservation for Deep Face Recognition

2025-08-15 · Durgesh Mishra, Rishabh Uikey arxiv

Knowledge Distillation is crucial for optimizing face recognition models for deployment in computationally limited settings, such as edge devices. Traditional KD methods, such as Raw L2 Feature Distillation or Feature Co…

Knowledge DistillationFace Recognition

Hierarchical Semantic Correlation-Aware Masked Autoencoder for Unsupervised Audio-Visual Representation Learning

2026-04-05 · Donghuo Zeng, Hao Niu, Masato Taya arxiv

Learning aligned multimodal embeddings from weakly paired, label-free corpora is challenging: pipelines often provide only pre-extracted features, clips contain multiple events, and spurious co-occurrences. We propose HS…

Representation Learning

Exploring Graph-based Knowledge: Multi-Level Feature Distillation via Channels Relational Graph

2024-05-14 · Zhiwei Wang, Jun Huang, Longhua Ma, Chengyu Wu 외

In visual tasks, large teacher models capture essential features and deep information, enhancing performance. However, distilling this information into smaller student models often leads to performance loss due to struct…