Zero-Shot Audio Classification with Factored Linear and Nonlinear Acoustic-Semantic Projections

2020-11-25 · Huang Xie, Okko Räsänen, Tuomas Virtanen

In this paper, we study zero-shot learning in audio classification through factored linear and nonlinear acoustic-semantic projections between audio instances and sound classes. Zero-shot learning in audio classification refers to classification problems that aim at recognizing audio instances of sound classes, which have no available training data but only semantic side information. In this paper, we address zero-shot learning by employing factored linear and nonlinear acoustic-semantic projections. We develop factored linear projections by applying rank decomposition to a bilinear model, and use nonlinear activation functions, such as tanh, to model the non-linearity between acoustic embeddings and semantic embeddings. Compared with the prior bilinear model, experimental results show that the proposed projection methods are effective for improving classification performance of zero-shot learning in audio classification.

📄 PDF Abstract BibTeX arXiv:2011.12657

Code (0)

등록된 구현이 없습니다.

Tasks

Audio Classification Classification General ClassificationZero-shot Audio ClassificationZero-Shot Learning

Zero-Shot Audio Classification Based on Class Label Embeddings

2019-05-06 · Huang Xie, Tuomas Virtanen

This paper proposes a zero-shot learning approach for audio classification based on the textual information about class labels without any audio samples from target classes. We propose an audio classification system buil…

Audio Classification Classification General Classification Zero-shot Audio Classification+1

Zero-Shot Audio Classification via Semantic Embeddings

2020-11-24 · Huang Xie, Tuomas Virtanen

In this paper, we study zero-shot learning in audio classification via semantic embeddings extracted from textual labels and sentence descriptions of sound classes. Our goal is to obtain a classifier that is capable of r…

Audio Classification Classification General Classification Sentence+3

Zero-Shot Audio Classification using Image Embeddings

2022-06-10 · Duygu Dogan, Huang Xie, Toni Heittola, Tuomas Virtanen

Supervised learning methods can solve the given problem in the presence of a large set of labeled data. However, the acquisition of a dataset covering all the target classes typically requires manual labeling which is ex…

Audio Classification Classification Zero-shot Audio Classification Zero-Shot Learning

Improving Audio Classification by Transitioning from Zero- to Few-Shot

2025-07-26 · James Taylor, Wolfgang Mack arxiv

State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated …

Contrastive Learning Audio Classification

Multi-label Zero-Shot Audio Classification with Temporal Attention

2024-08-31 · Duygu Dogan, Huang Xie, Toni Heittola, Tuomas Virtanen

Zero-shot learning models are capable of classifying new classes by transferring knowledge from the seen classes using auxiliary information. While most of the existing zero-shot learning methods focused on single-label …

Audio Classification Classification Zero-shot Audio Classification zero-shot-classification+1