paper-with-me

홈 › Papers

MiCE: Mixture of Contrastive Experts for Unsupervised Image Clustering

2021-05-05 · ICLR 2021 1 · Tsung Wei Tsai, Chongxuan Li, Jun Zhu

We present Mixture of Contrastive Experts (MiCE), a unified probabilistic clustering framework that simultaneously exploits the discriminative representations learned by contrastive learning and the semantic structures captured by a latent mixture model. Motivated by the mixture of experts, MiCE employs a gating function to partition an unlabeled dataset into subsets according to the latent semantics and multiple experts to discriminate distinct subsets of instances assigned to them in a contrastive learning manner. To solve the nontrivial inference and learning problems caused by the latent variables, we further develop a scalable variant of the Expectation-Maximization (EM) algorithm for MiCE and provide proof of the convergence. Empirically, we evaluate the clustering performance of MiCE on four widely adopted natural image datasets. MiCE achieves significantly better results than various previous methods and a strong contrastive learning baseline.

📄 PDF Abstract BibTeX arXiv:2105.01899

Code (1)

TsungWeiTsai/MiCE 공식 구현 pytorch

Tasks

ClusteringContrastive LearningImage ClusteringMixture-of-Experts

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

History-Augmented Contrastive Learning With Soft Mixture of Experts for Blind Super-Resolution of Planetary Remote Sensing Images

2025-11-25 · Hui-Jia Zhao, Jie Lu, Yunqing Jiang, Xiao-Ping Lu 외 arxiv

Blind Super-Resolution (BSR) in planetary remote sensing constitutes a highly ill-posed inverse problem, characterized by unknown degradation patterns and a complete absence of ground-truth supervision. Existing unsuperv…

Blind Super-ResolutionImage ReconstructionContrastive Learning

Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts

2022-10-07 · Nghia T. Le, Fan Bai, Alan Ritter

Anaphora resolution is an important task for information extraction across a range of languages, text genres, and domains, motivating the need for methods that do not require large annotated datasets. In-context learning…

In-Context LearningLanguage ModellingRetrieval

A Multimodal Foundation Model to Enhance Generalizability and Data Efficiency for Pan-cancer Prognosis Prediction

2025-09-16 · Huajun Zhou, Fengtao Zhou, Jiabo Ma, Yingxue Xu 외 arxiv

Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract…

SEMC: Structure-Enhanced Mixture-of-Experts Contrastive Learning for Ultrasound Standard Plane Recognition

2025-11-16 · Qing Cai, Guihao Yan, Fan Zhang, Cheng Zhang 외 arxiv

Ultrasound standard plane recognition is essential for clinical tasks such as disease screening, organ evaluation, and biometric measurement. However, existing methods fail to effectively exploit shallow structural infor…

Contrastive Learning

Explaining NLP Models via Minimal Contrastive Editing (MiCE)

2020-12-27 · Findings (ACL) 2021 8 · Alexis Ross, Ana Marasović, Matthew E. Peters

Humans have been shown to give contrastive explanations, which explain why an observed event happened rather than some other counterfactual event (the contrast case). Despite the influential role that contrastivity plays…

counterfactualMultiple-choiceQuestion AnsweringSentiment Analysis+2