paper-with-me

홈 › Papers

Noisy student-teacher training for robust keyword spotting

2021-06-03 · Hyun-Jin Park, Pai Zhu, Ignacio Lopez Moreno, Niranjan Subrahmanya

We propose self-training with noisy student-teacher approach for streaming keyword spotting, that can utilize large-scale unlabeled data and aggressive data augmentation. The proposed method applies aggressive data augmentation (spectral augmentation) on the input of both student and teacher and utilize unlabeled data at scale, which significantly boosts the accuracy of student against challenging conditions. Such aggressive augmentation usually degrades model performance when used with supervised training with hard-labeled data. Experiments show that aggressive spec augmentation on baseline supervised training method degrades accuracy, while the proposed self-training with noisy student-teacher training improves accuracy of some difficult-conditioned test sets by as much as 60%.

📄 PDF Abstract BibTeX arXiv:2106.01604

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationKeyword Spotting

Similar Papers 제목 키워드 기반

On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation

2023-07-06 · Gene-Ping Yang, Yue Gu, Qingming Tang, Dongsu Du 외

Large self-supervised models are effective feature extractors, but their application is challenging under on-device budget constraints and biased dataset collection, especially in keyword spotting. To address this, we pr…

Keyword SpottingKnowledge DistillationRepresentation LearningSpeech Representation Learning

Training Keyword Spotting Models on Non-IID Data with Federated Learning

2020-05-21 · Andrew Hard, Kurt Partridge, Cameron Nguyen, Niranjan Subrahmanya 외

We demonstrate that a production-quality keyword-spotting model can be trained on-device using federated learning and achieve comparable false accept and false reject rates to a centrally-trained model. To overcome the a…

Data AugmentationFederated LearningKeyword Spotting

Enhancing Few-shot Keyword Spotting Performance through Pre-Trained Self-supervised Speech Models

2025-06-21 · Alican Gok, Oguzhan Buyuksolak, Osman Erman Okman, Murat Saraclar

Keyword Spotting plays a critical role in enabling hands-free interaction for battery-powered edge devices. Few-Shot Keyword Spotting (FS-KWS) addresses the scalability and adaptability challenges of traditional systems …

Dimensionality ReductionKeyword SpottingKnowledge DistillationSelf-Supervised Learning

PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation

2021-06-25 · Jangho Kim, Simyung Chang, Nojun Kwak

As edge devices become prevalent, deploying Deep Neural Networks (DNN) on edge devices has become a critical issue. However, DNN requires a high computational resource which is rarely available for edge devices. To handl…

Keyword SpottingKnowledge DistillationModel CompressionQuantization

Developing Far-Field Speaker System Via Teacher-Student Learning

2018-04-14 · Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu 외

In this study, we develop the keyword spotting (KWS) and acoustic model (AM) components in a far-field speaker system. Specifically, we use teacher-student (T/S) learning to adapt a close-talk well-trained production AM …

Keyword SpottingModel Compression