Compositional Clustering: Applications to Multi-Label Object Recognition and Speaker Identification
We consider a novel clustering task in which clusters can have compositional relationships, e.g., one cluster contains images of rectangles, one contains images of circles, and a third (compositional) cluster contains images with both objects. In contrast to hierarchical clustering in which a parent cluster represents the intersection of properties of the child clusters, our problem is about finding compositional clusters that represent the union of the properties of the constituent clusters. This task is motivated by recently developed few-shot learning and embedding models can distinguish the label sets, not just the individual labels, assigned to the examples. We propose three new algorithms -- Compositional Affinity Propagation (CAP), Compositional k-means (CKM), and Greedy Compositional Reassignment (GCR) -- that can partition examples into coherent groups and infer the compositional structure among them. We show promising results, compared to popular algorithms such as Gaussian mixtures, Fuzzy c-means, and Agglomerative Clustering, on the OmniGlot and LibriSpeech datasets. Our work has applications to open-world multi-label object recognition and speaker identification & diarization with simultaneous speech from multiple speakers.
Code (1)
Tasks
ClusteringFew-Shot LearningObject Recognitionspeaker-diarizationSpeaker DiarizationSpeaker IdentificationSimilar Papers 제목 키워드 기반
Compositional Embeddings for Multi-Label One-Shot Learning
We present a compositional embedding framework that infers not just a single class per input image, but a set of classes, in the setting of one-shot learning. Specifically, we propose and evaluate several novel models co…
Object DetectionObject RecognitionOne-Shot LearningSpeaker DiarizationMultiplex Dirichlet stochastic block model for clustering multidimensional compositional networks
Network data often represent multiple types of relations, which can also denote exchanged quantities, and are typically encompassed in a weighted multiplex. Such data frequently exhibit clustering structures, however, tr…
ClusteringStochastic Block ModelObject-Compositional Neural Implicit Surfaces
The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore…
3D ReconstructionNovel View SynthesisObjectSequencing Silicates in the IRS Debris Disk Catalog I: Methodology for Unsupervised Clustering
Debris disks, which consist of dust, planetesimals, planets, and gas, offer a unique window into the mineralogical composition of their parent bodies, especially during the critical phase of terrestrial planet formation …
ClusteringDiversityInterpretable Machine LearningSCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval
Compositional image retrieval (CIR) is a multimodal learning task where a model combines a query image with a user-provided text modification to retrieve a target image. CIR finds applications in a variety of domains inc…
Image RetrievalRetrievalTripletZero-Shot Composed Image Retrieval (ZS-CIR)