paper-with-me

Papers

Learning Representations for Clustering via Partial Information Discrimination and Cross-Level Interaction

2024-01-24 · Hai-Xin Zhang, Dong Huang, Hua-Bao Ling, Guang-Yu Zhang, Wei-jun Sun, Zi-hao Wen

In this paper, we present a novel deep image clustering approach termed PICI, which enforces the partial information discrimination and the cross-level interaction in a joint learning framework. In particular, we leverage a Transformer encoder as the backbone, through which the masked image modeling with two paralleled augmented views is formulated. After deriving the class tokens from the masked images by the Transformer encoder, three partial information learning modules are further incorporated, including the PISD module for training the auto-encoder via masked image reconstruction, the PICD module for employing two levels of contrastive learning, and the CLI module for mutual interaction between the instance-level and cluster-level subspaces. Extensive experiments have been conducted on six real-world image datasets, which demononstrate the superior clustering performance of the proposed PICI approach over the state-of-the-art deep clustering approaches. The source code is available at https://github.com/Regan-Zhang/PICI.

📄 PDF Abstract BibTeX arXiv:2401.13503

Code (1)

regan-zhang/pici 공식 구현 pytorch

Tasks

ClusteringContrastive LearningDeep ClusteringImage ClusteringImage ReconstructionSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Towards Self-similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation

2019-04-13 · Chao Chen, Zhihang Fu, Zhihong Chen, Zhaowei Cheng 외

Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global distribution alignment without considering class information across domains. The neglect of class information, h…

Domain AdaptationUnsupervised Domain Adaptation

Clustering with Jointly Learned Nonlinear Transforms Over Discriminating Min-Max Similarity/Dissimilarity Assignment

2019-01-30 · Dimche Kostadinov, Behrooz Razeghi, Taras Holotyak, Slava Voloshynovskiy

This paper presents a novel clustering concept that is based on jointly learned nonlinear transforms (NTs) with priors on the information loss and the discrimination. We introduce a clustering principle that is based on …

ClusteringImage Clustering

Unsupervised Visual Representation Learning by Online Constrained K-Means

2021-05-24 · CVPR 2022 1 · Qi Qian, Yuanhong Xu, Juhua Hu, Hao Li 외

Cluster discrimination is an effective pretext task for unsupervised representation learning, which often consists of two phases: clustering and discrimination. Clustering is to assign each instance a pseudo label that w…

ClusteringContrastive LearningImage ClusteringMetric Learning+5

Stable Cluster Discrimination for Deep Clustering

2023-11-24 · ICCV 2023 1 · Qi Qian

Deep clustering can optimize representations of instances (i.e., representation learning) and explore the inherent data distribution (i.e., clustering) simultaneously, which demonstrates a superior performance over conve…

ClusteringDeep ClusteringImage ClusteringRepresentation Learning+1

DAS-PMVC: A Framework for Partial Multi-View Clustering via Dual Alignment and Structure Enhancement

2026-07-30 · Shubin Ma, Liang Zhao, Chuanye He, Zhenjiao Liu 외 arxiv

In recent years, multi-view clustering has attracted widespread research interest. However, due to limitations in data collection devices, data across different views often suffer from misalignment, leading to the partia…

Contrastive Learning