paper-with-me

홈 › Papers

Cluster-based pruning techniques for audio data

2023-09-21 · Boris Bergsma, Marta Brzezinska, Oleg V. Yazyev, Milos Cernak

Deep learning models have become widely adopted in various domains, but their performance heavily relies on a vast amount of data. Datasets often contain a large number of irrelevant or redundant samples, which can lead to computational inefficiencies during the training. In this work, we introduce, for the first time in the context of the audio domain, the k-means clustering as a method for efficient data pruning. K-means clustering provides a way to group similar samples together, allowing the reduction of the size of the dataset while preserving its representative characteristics. As an example, we perform clustering analysis on the keyword spotting (KWS) dataset. We discuss how k-means clustering can significantly reduce the size of audio datasets while maintaining the classification performance across neural networks (NNs) with different architectures. We further comment on the role of scaling analysis in identifying the optimal pruning strategies for a large number of samples. Our studies serve as a proof-of-principle, demonstrating the potential of data selection with distance-based clustering algorithms for the audio domain and highlighting promising research avenues.

📄 PDF Abstract BibTeX arXiv:2309.11922

Code (1)

boris-bergsma/audio_pruning 공식 구현 tf

Tasks

ClusteringKeyword Spotting

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…

Similar Papers 제목 키워드 기반

Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices

2021-08-13 · Md Mohaimenuzzaman, Christoph Bergmeir, Bernd Meyer

Deep learning has celebrated resounding successes in many application areas of relevance to the Internet of Things (IoT), such as computer vision and machine listening. These technologies must ultimately be brought direc…

Audio ClassificationClassificationDeep Learningimage-classification+4

A Unified Framework of DNN Weight Pruning and Weight Clustering/Quantization Using ADMM

2018-11-05 · Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Jiayu Li 외

Many model compression techniques of Deep Neural Networks (DNNs) have been investigated, including weight pruning, weight clustering and quantization, etc. Weight pruning leverages the redundancy in the number of weights…

ClusteringModel CompressionQuantization

CA-AFP: Cluster-Aware Adaptive Federated Pruning

2026-03-02 · Om Govind Jha, Harsh Shukla, Haroon R. Lone arxiv

Federated Learning (FL) faces major challenges in real-world deployments due to statistical heterogeneity across clients and system heterogeneity arising from resource-constrained devices. While clustering-based approach…

Human Activity RecognitionFederated Learning

Structured Deep Neural Network Pruning via Matrix Pivoting

2017-12-01 · Ranko Sredojevic, Shaoyi Cheng, Lazar Supic, Rawan Naous 외

Deep Neural Networks (DNNs) are the key to the state-of-the-art machine vision, sensor fusion and audio/video signal processing. Unfortunately, their computation complexity and tight resource constraints on the Edge make…

DiversityNetwork PruningSensor Fusion

Speaker Clustering With Neural Networks And Audio Processing

2018-03-22 · Maxime Jumelle, Taqiyeddine Sakmeche

Speaker clustering is the task of differentiating speakers in a recording. In a way, the aim is to answer "who spoke when" in audio recordings. A common method used in industry is feature extraction directly from the rec…

Clustering