paper-with-me

Papers

Fully Few-shot Class-incremental Audio Classification Using Multi-level Embedding Extractor and Ridge Regression Classifier

2025-06-23 · Yongjie Si, Yanxiong Li, Jiaxin Tan, Qianhua He, Il-Youp Kwak

In the task of Few-shot Class-incremental Audio Classification (FCAC), training samples of each base class are required to be abundant to train model. However, it is not easy to collect abundant training samples for many base classes due to data scarcity and high collection cost. We discuss a more realistic issue, Fully FCAC (FFCAC), in which training samples of both base and incremental classes are only a few. Furthermore, we propose a FFCAC method using a model which is decoupled into a multi-level embedding extractor and a ridge regression classifier. The embedding extractor consists of an encoder of audio spectrogram Transformer and a fusion module, and is trained in the base session but frozen in all incremental sessions. The classifier is updated continually in each incremental session. Results on three public datasets show that our method exceeds current methods in accuracy, and has advantage over most of them in complexity. The code is at https://github.com/YongjieSi/MAR.

📄 PDF Abstract BibTeX arXiv:2506.18406

Code (1)

yongjiesi/mar 공식 구현 pytorch

Tasks

Audio Classification

Methods 이 논문이 사용한 방법론

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Similar Papers 제목 키워드 기반

Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor

2024-06-12 · Yongjie Si, Yanxiong Li, Jialong Li, Jiaxin Tan 외

It's assumed that training data is sufficient in base session of few-shot class-incremental audio classification. However, it's difficult to collect abundant samples for model training in base session in some practical s…

Audio Classification

Few-shot Class-incremental Audio Classification Using Stochastic Classifier

2023-06-03 · Yanxiong Li, Wenchang Cao, Jialong Li, Wei Xie 외

It is generally assumed that number of classes is fixed in current audio classification methods, and the model can recognize pregiven classes only. When new classes emerge, the model needs to be retrained with adequate s…

Audio ClassificationClassification

Few-shot Class-variable Incremental Audio Classification via Prototype Adaptation and Pseudo Class-variable Training

2026-06-08 · Yanxiong Li, Guoqing Chen, Qianqian Li, Sen Huang arxiv

In the task of few-shot class-incremental audio classification, the number of classes is assumed to always increase without considering the possibility of decrease. However, the number of classes generally increases or d…

Audio Classification

Few-shot Class-incremental Audio Classification Using Dynamically Expanded Classifier with Self-attention Modified Prototypes

2023-05-31 · Yanxiong Li, Wenchang Cao, Wei Xie, Jialong Li 외

Most existing methods for audio classification assume that the vocabulary of audio classes to be classified is fixed. When novel (unseen) audio classes appear, audio classification systems need to be retrained with abund…

Audio ClassificationClassification

Towards Robust Few-shot Class Incremental Learning in Audio Classification using Contrastive Representation

2024-07-27 · Riyansha Singh, Parinita Nema, Vinod K Kurmi

In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arisi…

Audio Classificationclass-incremental learningClass Incremental LearningContrastive Learning+2