paper-with-me

홈 › Papers

Dynamic Metric Learning from Pairwise Comparisons

2016-10-10 · Kristjan Greenewald, Stephen Kelley, Alfred Hero III

Recent work in distance metric learning has focused on learning transformations of data that best align with specified pairwise similarity and dissimilarity constraints, often supplied by a human observer. The learned transformations lead to improved retrieval, classification, and clustering algorithms due to the better adapted distance or similarity measures. Here, we address the problem of learning these transformations when the underlying constraint generation process is nonstationary. This nonstationarity can be due to changes in either the ground-truth clustering used to generate constraints or changes in the feature subspaces in which the class structure is apparent. We propose Online Convex Ensemble StrongLy Adaptive Dynamic Learning (OCELAD), a general adaptive, online approach for learning and tracking optimal metrics as they change over time that is highly robust to a variety of nonstationary behaviors in the changing metric. We apply the OCELAD framework to an ensemble of online learners. Specifically, we create a retro-initialized composite objective mirror descent (COMID) ensemble (RICE) consisting of a set of parallel COMID learners with different learning rates, demonstrate RICE-OCELAD on both real and synthetic data sets and show significant performance improvements relative to previously proposed batch and online distance metric learning algorithms.

📄 PDF Abstract BibTeX arXiv:1610.03090

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringMetric LearningRetrieval

Similar Papers 제목 키워드 기반

Decreasing Annotation Burden of Pairwise Comparisons with Human-in-the-Loop Sorting: Application in Medical Image Artifact Rating

2022-02-10 · Ikbeom Jang, Garrison Danley, Ken Chang, Jayashree Kalpathy-Cramer

Ranking by pairwise comparisons has shown improved reliability over ordinal classification. However, as the annotations of pairwise comparisons scale quadratically, this becomes less practical when the dataset is large. …

Ordinal Classification

Active Ranking from Pairwise Comparisons and when Parametric Assumptions Don't Help

2016-06-28 · Reinhard Heckel, Nihar B. Shah, Kannan Ramchandran, Martin J. Wainwright

We consider sequential or active ranking of a set of n items based on noisy pairwise comparisons. Items are ranked according to the probability that a given item beats a randomly chosen item, and ranking refers to partit…

Open-Ended Question Answering

Confidence and Stability of Global and Pairwise Scores in NLP Evaluation

2025-07-02 · Georgii Levtsov, Dmitry Ustalov arxiv

With the advent of highly capable instruction-tuned neural language models, benchmarking in natural language processing (NLP) is increasingly shifting towards pairwise comparison leaderboards, such as LMSYS Arena, from t…

Text Generation

Metric Learning from Limited Pairwise Preference Comparisons

2024-03-28 · Zhi Wang, Geelon So, Ramya Korlakai Vinayak

We study metric learning from preference comparisons under the ideal point model, in which a user prefers an item over another if it is closer to their latent ideal item. These items are embedded into $\mathbb{R}^d$ equi…

Metric Learning

Ranking and Selection from Pairwise Comparisons: Empirical Bayes Methods for Citation Analysis

2021-12-21 · Jiaying Gu, Roger Koenker

We study the Stigler model of citation flows among journals adapting the pairwise comparison model of Bradley and Terry to do ranking and selection of journal influence based on nonparametric empirical Bayes procedures. …