paper-with-me

홈 › Papers

Analysis of Self-Supervised Learning and Dimensionality Reduction Methods in Clustering-Based Active Learning for Speech Emotion Recognition

2022-06-21 · Einari Vaaras, Manu Airaksinen, Okko Räsänen

When domain experts are needed to perform data annotation for complex machine-learning tasks, reducing annotation effort is crucial in order to cut down time and expenses. For cases when there are no annotations available, one approach is to utilize the structure of the feature space for clustering-based active learning (AL) methods. However, these methods are heavily dependent on how the samples are organized in the feature space and what distance metric is used. Unsupervised methods such as contrastive predictive coding (CPC) can potentially be used to learn organized feature spaces, but these methods typically create high-dimensional features which might be challenging for estimating data density. In this paper, we combine CPC and multiple dimensionality reduction methods in search of functioning practices for clustering-based AL. Our experiments for simulating speech emotion recognition system deployment show that both the local and global topology of the feature space can be successfully used for AL, and that CPC can be used to improve clustering-based AL performance over traditional signal features. Additionally, we observe that compressing data dimensionality does not harm AL performance substantially, and that 2-D feature representations achieved similar AL performance as higher-dimensional representations when the number of annotations is not very low.

📄 PDF Abstract BibTeX arXiv:2206.10188

Code (1)

SPEECHCOG/cpc_pytorch 공식 구현 pytorch

Tasks

Active LearningClusteringDimensionality ReductionEmotion RecognitionSelf-Supervised LearningSpeech Emotion Recognition

Methods 이 논문이 사용한 방법론

InfoNCE 설명 없음
Contrastive Predictive Coding Contrastive Predictive Coding (CPC) learns self-supervised representations by predicting the future in latent space by using powerful autoregressive models. The model uses a…

Similar Papers 제목 키워드 기반

A review of unsupervised learning in astronomy

2024-06-25 · Sotiria Fotopoulou

This review summarizes popular unsupervised learning methods, and gives an overview of their past, current, and future uses in astronomy. Unsupervised learning aims to organise the information content of a dataset, in su…

AstronomyClusteringDimensionality Reduction

TLDR: Twin Learning for Dimensionality Reduction

2021-10-18 · Yannis Kalantidis, Carlos Lassance, Jon Almazan, Diane Larlus

Dimensionality reduction methods are unsupervised approaches which learn low-dimensional spaces where some properties of the initial space, typically the notion of "neighborhood", are preserved. Such methods usually requ…

Dimensionality ReductionRepresentation LearningRetrievalSelf-Supervised Learning

MAPLE: Self-Supervised Learning-Enhanced Nonlinear Dimensionality Reduction for Visual Analysis

2026-01-28 · Zeyang Huang, Takanori Fujiwara, Angelos Chatzimparmpas, Wandrille Duchemin 외 arxiv

We present a new nonlinear dimensionality reduction method, MAPLE, that enhances UMAP by improving manifold modeling. MAPLE employs a self-supervised learning approach to more efficiently encode low-dimensional manifold …

Self-Supervised LearningDimensionality Reduction

Dimensionality Reduction for Hyperspectral Image Classification

2026-09-09 · Mohamed Cherifi, Ammar Mesloub, Mohammed Nabil El Korso, Tayeb Touhami 외 arxiv

This paper addresses the issue of supervised classification in the context of hyperspectral satellite images. It deals with two fundamental aspects: dimensionality reduction of data and the selection of appropriate super…

Hyperspectral Image ClassificationDimensionality Reduction

SRP: Efficient class-aware embedding learning for large-scale data via supervised random projections

2018-11-07 · Amir-Hossein Karimi, Alexander Wong, Ali Ghodsi

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the …

Dimensionality ReductionSupervised dimensionality reduction