Zero-shot Active Learning with Topological Clustering for Multiclass Classification
We present a novel approach for zero-shot active learning for multi-class classification based on a clustering technique, called ToMATo, which is guided by topological persistence. Our objective is to identify effective regions in the feature space for label querying. The labeling of examples in these regions will allow the training of efficient multi-class classification prediction functions. We have adapted ToMATo with a density aware $\delta$-Rips graph in order to obtain homogeneous simplicial trees. From these trees, informative simplices are identified with respect to the annotation effort, or the budget. Representative examples from each of them are labeled by an oracle and these labels are then propagated through the trees. We adapt ToMATo by computing our persistence diagram (PD) from a $\delta$-Rips graph that is estimated using a $k$-nearest neighbor distance matrix. This allows the application of the method to large scale scenarios. From this perspective we also propose a local density estimator from the same distance matrix. Comparisons on different benchmarks show that the proposed approach greatly improves performance with respect to a random querying strategy for label assignment that has been found outperforming state-of-the art approaches in previous works.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningClusteringMulti-class ClassificationSimilar Papers 제목 키워드 기반
Relative Representations: Topological and Geometric Perspectives
Relative representations are an established approach to zero-shot model stitching, consisting of a non-trainable transformation of the latent space of a deep neural network. Based on insights of topological and geometric…
Revisiting Discriminative vs. Generative Classifiers: Theory and Implications
A large-scale deep model pre-trained on massive labeled or unlabeled data transfers well to downstream tasks. Linear evaluation freezes parameters in the pre-trained model and trains a linear classifier separately, which…
Few-Shot LearningImage ClassificationLinear evaluationregressionMulticlass Total Variation Clustering
Ideas from the image processing literature have recently motivated a new set of clustering algorithms that rely on the concept of total variation. While these algorithms perform well for bi-partitioning tasks, their recu…
ClusteringSATR: Zero-Shot Semantic Segmentation of 3D Shapes
We explore the task of zero-shot semantic segmentation of 3D shapes by using large-scale off-the-shelf 2D image recognition models. Surprisingly, we find that modern zero-shot 2D object detectors are better suited for th…
SegmentationSemantic SegmentationZero-Shot Semantic SegmentationQuickly Tuning Foundation Models for Image Segmentation
Foundation models like SAM (Segment Anything Model) exhibit strong zero-shot image segmentation performance, but often fall short on domain-specific tasks. Fine-tuning these models typically requires significant manual e…
Hyperparameter OptimizationImage Segmentation