paper-with-me

홈 › Papers

From Logits to Hierarchies: Hierarchical Clustering made Simple

2024-10-10 · Emanuele Palumbo, Moritz Vandenhirtz, Alain Ryser, Imant Daunhawer, Julia E. Vogt

The structure of many real-world datasets is intrinsically hierarchical, making the modeling of such hierarchies a critical objective in both unsupervised and supervised machine learning. Recently, novel approaches for hierarchical clustering with deep architectures have been proposed. In this work, we take a critical perspective on this line of research and demonstrate that many approaches exhibit major limitations when applied to realistic datasets, partly due to their high computational complexity. In particular, we show that a lightweight procedure implemented on top of pre-trained non-hierarchical clustering models outperforms models designed specifically for hierarchical clustering. Our proposed approach is computationally efficient and applicable to any pre-trained clustering model that outputs logits, without requiring any fine-tuning. To highlight the generality of our findings, we illustrate how our method can also be applied in a supervised setup, recovering meaningful hierarchies from a pre-trained ImageNet classifier.

📄 PDF Abstract BibTeX arXiv:2410.07858

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

I Want 'Em All (At Once) -- Ultrametric Cluster Hierarchies

2025-02-19 · Andrew Draganov, Pascal Weber, Rasmus Skibdahl Melanchton Jørgensen, Anna Beer 외

Hierarchical clustering is a powerful tool for exploratory data analysis, organizing data into a tree of clusterings from which a partition can be chosen. This paper generalizes these ideas by proving that, for any reaso…

AllClustering

Evaluating Hierarchies of Verb Argument Structure with Hierarchical Clustering

2017-09-01 · EMNLP 2017 9 · Jesse Mu, Joshua K. Hartshorne, Timothy O{'}Donnell

Verbs can only be used with a few specific arrangements of their arguments (syntactic frames). Most theorists note that verbs can be organized into a hierarchy of verb classes based on the frames they admit. Here we show…

ClusteringLanguage AcquisitionNatural Language InferenceSemantic Parsing

Hierarchical Data Generator based on Tree-Structured Stick Breaking Process for Benchmarking Clustering Methods

2016-06-17 · Łukasz P. Olech, Michał Spytkowski, Halina Kwaśnicka, Zbigniew Michalewicz

Object Cluster Hierarchies is a new variant of Hierarchical Cluster Analysis that gains interest in the field of Machine Learning. Being still at an early stage of development, the lack of tools for systematic analysis o…

BenchmarkingClusteringObject

A cost function for similarity-based hierarchical clustering

2015-10-16 · Sanjoy Dasgupta

The development of algorithms for hierarchical clustering has been hampered by a shortage of precise objective functions. To help address this situation, we introduce a simple cost function on hierarchies over a set of p…

Clustering

Cross-modal Scalable Hierarchical Clustering in Hyperbolic space

2023-01-01 · ICCV 2023 1 · Teng Long, Nanne van Noord

Hierarchical clustering is a natural approach to discover ontologies from data. Yet, existing approaches are hampered by their inability to scale to large datasets and the discrete encoding of the hierarchy. We intro…

Activity RecognitionClusteringSelf-Supervised Learning