paper-with-me

Papers

Improving k-Means Clustering Performance with Disentangled Internal Representations

2020-06-05 · Abien Fred Agarap, Arnulfo P. Azcarraga

Deep clustering algorithms combine representation learning and clustering by jointly optimizing a clustering loss and a non-clustering loss. In such methods, a deep neural network is used for representation learning together with a clustering network. Instead of following this framework to improve clustering performance, we propose a simpler approach of optimizing the entanglement of the learned latent code representation of an autoencoder. We define entanglement as how close pairs of points from the same class or structure are, relative to pairs of points from different classes or structures. To measure the entanglement of data points, we use the soft nearest neighbor loss, and expand it by introducing an annealing temperature factor. Using our proposed approach, the test clustering accuracy was 96.2% on the MNIST dataset, 85.6% on the Fashion-MNIST dataset, and 79.2% on the EMNIST Balanced dataset, outperforming our baseline models.

📄 PDF Abstract BibTeX arXiv:2006.04535

Code (1)

https://gitlab.com/afagarap/pt-snnl pytorch

Tasks

ClusteringDeep ClusteringImage ClassificationImage ClusteringRepresentation Learning

Methods 이 논문이 사용한 방법론

Annealing SNNL 설명 없음

Similar Papers 제목 키워드 기반

Dual-disentangled Deep Multiple Clustering

2024-02-07 · Jiawei Yao, Juhua Hu

Multiple clustering has gathered significant attention in recent years due to its potential to reveal multiple hidden structures of the data from different perspectives. Most of multiple clustering methods first derive f…

ClusteringDisentanglement

URECA: The Chain of Two Minimum Set Cover Problems exists behind Adaptation to Shifts in Semantic Code Search

2025-02-11 · Seok-Ung Choi, Joonghyuk Hahn, Yo-Sub Han

Adaptation is to make model learn the patterns shifted from the training distribution. In general, this adaptation is formulated as the minimum entropy problem. However, the minimum entropy problem has inherent limitatio…

ClusteringCode Search

Concept Algebra for (Score-Based) Text-Controlled Generative Models

2023-02-07 · NeurIPS 2023 11 · ZiHao Wang, Lin Gui, Jeffrey Negrea, Victor Veitch

This paper concerns the structure of learned representations in text-guided generative models, focusing on score-based models. A key property of such models is that they can compose disparate concepts in a `disentangled'…

Multi-VAE: Learning Disentangled View-common and View-peculiar Visual Representations for Multi-view Clustering

2021-06-21 · ICCV 2021 10 · Jie Xu, Yazhou Ren, Huayi Tang, Xiaorong Pu 외

Multi-view clustering, a long-standing and important research problem, focuses on mining complementary information from diverse views. However, existing works often fuse multiple views' representations or handle clusteri…

Clustering

Forced to Learn: Discovering Disentangled Representations Without Exhaustive Labels

2017-05-01 · Alexey Romanov, Anna Rumshisky

Learning a better representation with neural networks is a challenging problem, which was tackled extensively from different prospectives in the past few years. In this work, we focus on learning a representation that co…

Clustering