Learning to Link
Clustering is an important part of many modern data analysis pipelines, including network analysis and data retrieval. There are many different clustering algorithms developed by various communities, and it is often not clear which algorithm will give the best performance on a specific clustering task. Similarly, we often have multiple ways to measure distances between data points, and the best clustering performance might require a non-trivial combination of those metrics. In this work, we study data-driven algorithm selection and metric learning for clustering problems, where the goal is to simultaneously learn the best algorithm and metric for a specific application. The family of clustering algorithms we consider is parameterized linkage based procedures that includes single and complete linkage. The family of distance functions we learn over are convex combinations of base distance functions. We design efficient learning algorithms which receive samples from an application-specific distribution over clustering instances and simultaneously learn both a near-optimal distance and clustering algorithm from these classes. We also carry out a comprehensive empirical evaluation of our techniques showing that they can lead to significantly improved clustering performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringMetric LearningRetrievalSimilar Papers 제목 키워드 기반
Link Budget Analysis for Free-Space Optical Satellite Networks
Free-space optical satellite networks (FSOSNs) will employ free-space optical links between satellites and between satellites and ground stations, and the link budget for optical inter-satellite links and optical uplink/…
High-order joint embedding for multi-level link prediction
Link prediction infers potential links from observed networks, and is one of the essential problems in network analyses. In contrast to traditional graph representation modeling which only predicts two-way pairwise relat…
Link PredictionNetwork EmbeddingPredictionVocal Bursts Intensity PredictionLink-aware link prediction over temporal graph by pattern recognition
A temporal graph can be considered as a stream of links, each of which represents an interaction between two nodes at a certain time. On temporal graphs, link prediction is a common task, which aims to answer whether the…
Link PredictionPredictionLinkBERT: Pretraining Language Models with Document Links
Language model (LM) pretraining can learn various knowledge from text corpora, helping downstream tasks. However, existing methods such as BERT model a single document, and do not capture dependencies or knowledge that s…
Document ClassificationLanguage ModelingLanguage ModellingMasked Language Modeling+10Solving Multi-Structured Problems by Introducing Linkage Kernels into GOMEA
Model-Based Evolutionary Algorithms (MBEAs) can be highly scalable by virtue of linkage (or variable interaction) learning. This requires, however, that the linkage model can capture the exploitable structure of a proble…
Evolutionary Algorithms