paper-with-me

홈 › Papers

Ranking Data with Continuous Labels through Oriented Recursive Partitions

2018-01-17 · NeurIPS 2017 12 · Stephan Clémençon, Mastane Achab

We formulate a supervised learning problem, referred to as continuous ranking, where a continuous real-valued label Y is assigned to an observable r.v. X taking its values in a feature space $\mathcal{X}$ and the goal is to order all possible observations x in $\mathcal{X}$ by means of a scoring function $s:\mathcal{X}\rightarrow \mathbb{R}$ so that s(X) and Y tend to increase or decrease together with highest probability. This problem generalizes bi/multi-partite ranking to a certain extent and the task of finding optimal scoring functions s(x) can be naturally cast as optimization of a dedicated functional criterion, called the IROC curve here, or as maximization of the Kendall ${\tau}$ related to the pair (s(X), Y ). From the theoretical side, we describe the optimal elements of this problem and provide statistical guarantees for empirical Kendall ${\tau}$ maximization under appropriate conditions for the class of scoring function candidates. We also propose a recursive statistical learning algorithm tailored to empirical IROC curve optimization and producing a piecewise constant scoring function that is fully described by an oriented binary tree. Preliminary numerical experiments highlight the difference in nature between regression and continuous ranking and provide strong empirical evidence of the performance of empirical optimizers of the criteria proposed.

📄 PDF Abstract BibTeX arXiv:1801.05772

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Image-Text Retrieval with Binary and Continuous Label Supervision

2022-10-20 · Zheng Li, Caili Guo, Zerun Feng, Jenq-Neng Hwang 외

Most image-text retrieval work adopts binary labels indicating whether a pair of image and text matches or not. Such a binary indicator covers only a limited subset of image-text semantic relations, which is insufficient…

Image CaptioningImage-text RetrievalRetrievalText Retrieval+2

OrdRankBen: A Novel Ranking Benchmark for Ordinal Relevance in NLP

2025-03-02 · Yan Wang, Lingfei Qian, Xueqing Peng, Jimin Huang 외

The evaluation of ranking tasks remains a significant challenge in natural language processing (NLP), particularly due to the lack of direct labels for results in real-world scenarios. Benchmark datasets play a crucial r…

ReRankMatch: Semi-Supervised Learning with Semantics-Oriented Similarity Representation

2021-02-12 · Trung Quang Tran, Mingu Kang, Daeyoung Kim

This paper proposes integrating semantics-oriented similarity representation into RankingMatch, a recently proposed semi-supervised learning method. Our method, dubbed ReRankMatch, aims to deal with the case in which lab…

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

2024-04-17 · Le Yan, Zhen Qin, Honglei Zhuang, Rolf Jagerman 외

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevan…

A generalized framework to predict continuous scores from medical ordinal labels

2023-05-30 · Katharina V. Hoebel, Andreanne Lemay, John Peter Campbell, Susan Ostmo 외

Many variables of interest in clinical medicine, like disease severity, are recorded using discrete ordinal categories such as normal/mild/moderate/severe. These labels are used to train and evaluate disease severity pre…

Multi-class ClassificationOrdinal Classificationseverity prediction