paper-with-me

Papers

Compositional Clustering: Applications to Multi-Label Object Recognition and Speaker Identification

2021-09-09 · Zeqian Li, Xinlu He, Jacob Whitehill

We consider a novel clustering task in which clusters can have compositional relationships, e.g., one cluster contains images of rectangles, one contains images of circles, and a third (compositional) cluster contains images with both objects. In contrast to hierarchical clustering in which a parent cluster represents the intersection of properties of the child clusters, our problem is about finding compositional clusters that represent the union of the properties of the constituent clusters. This task is motivated by recently developed few-shot learning and embedding models can distinguish the label sets, not just the individual labels, assigned to the examples. We propose three new algorithms -- Compositional Affinity Propagation (CAP), Compositional k-means (CKM), and Greedy Compositional Reassignment (GCR) -- that can partition examples into coherent groups and infer the compositional structure among them. We show promising results, compared to popular algorithms such as Gaussian mixtures, Fuzzy c-means, and Agglomerative Clustering, on the OmniGlot and LibriSpeech datasets. Our work has applications to open-world multi-label object recognition and speaker identification & diarization with simultaneous speech from multiple speakers.

📄 PDF Abstract BibTeX arXiv:2109.04160

Code (1)

jwhitehill/compositionalclustering 공식 구현 pytorch

Tasks

ClusteringFew-Shot LearningObject Recognitionspeaker-diarizationSpeaker DiarizationSpeaker Identification

Similar Papers 제목 키워드 기반

Compositional Embeddings for Multi-Label One-Shot Learning

2020-02-11 · Zeqian Li, Michael C. Mozer, Jacob Whitehill

We present a compositional embedding framework that infers not just a single class per input image, but a set of classes, in the setting of one-shot learning. Specifically, we propose and evaluate several novel models co…

Object DetectionObject RecognitionOne-Shot LearningSpeaker Diarization

Multiplex Dirichlet stochastic block model for clustering multidimensional compositional networks

2024-12-16 · Iuliia Promskaia, Adrian O'Hagan, Michael Fop

Network data often represent multiple types of relations, which can also denote exchanged quantities, and are typically encompassed in a weighted multiplex. Such data frequently exhibit clustering structures, however, tr…

ClusteringStochastic Block Model

Object-Compositional Neural Implicit Surfaces

2022-07-20 · Qianyi Wu, Xian Liu, Yuedong Chen, Kejie Li 외

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore…

3D ReconstructionNovel View SynthesisObject

Sequencing Silicates in the IRS Debris Disk Catalog I: Methodology for Unsupervised Clustering

2025-01-02 · Cicero X. Lu, Tushar Mittal, Christine H. Chen, Alexis Y. Li 외

Debris disks, which consist of dust, planetesimals, planets, and gas, offer a unique window into the mineralogical composition of their parent bodies, especially during the critical phase of terrestrial planet formation …

ClusteringDiversityInterpretable Machine Learning

SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval

2025-01-12 · WACV 2025 3 · Bhavin Jawade, Joao V. B. Soares, Kapil Thadani, Deen Dayal Mohan 외

Compositional image retrieval (CIR) is a multimodal learning task where a model combines a query image with a user-provided text modification to retrieve a target image. CIR finds applications in a variety of domains inc…

Image RetrievalRetrievalTripletZero-Shot Composed Image Retrieval (ZS-CIR)