paper-with-me

홈 › Papers

Learning to Rank by Optimizing NDCG Measure

2009-12-01 · NeurIPS 2009 12 · Hamed Valizadegan, Rong Jin, Ruofei Zhang, Jianchang Mao

Learning to rank is a relatively new field of study, aiming to learn a ranking function from a set of training data with relevancy labels. The ranking algorithms are often evaluated using Information Retrieval measures, such as Normalized Discounted Cumulative Gain [1] and Mean Average Precision [2]. Until recently, most learning to rank algorithms were not using a loss function related to the above mentioned evaluation measures. The main difficulty in direct optimization of these measures is that they depend on the ranks of documents, not the numerical values output by the ranking function. We propose a probabilistic framework that addresses this challenge by optimizing the expectation of NDCG over all the possible permutations of documents. A relaxation strategy is used to approximate the average of NDCG over the space of permutation, and a bound optimization approach is proposed to make the computation efficient. Extensive experiments show that the proposed algorithm outperforms state-of-the-art ranking algorithms on several benchmark data sets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalLearning-To-RankRetrieval

Similar Papers 제목 키워드 기반

Ranking Preserving Hashing for Fast Similarity Search

2015-06-27 · AAAI 2015 6 · Qifan Wang, Zhiwei Zhang, Luo Si

Hashing method becomes popular for large scale similarity search due to its storage and computational efficiency. Many machine learning techniques, ranging from unsupervised to supervised, have been proposed to design co…

Computational Efficiency

A Theoretical Analysis of NDCG Type Ranking Measures

2013-04-24 · Yining Wang, Li-Wei Wang, Yuanzhi Li, Di He 외

A central problem in ranking is to design a ranking measure for evaluation of ranking functions. In this paper we study, from a theoretical perspective, the widely used Normalized Discounted Cumulative Gain (NDCG)-type r…

Vocal Bursts Type Prediction

Large-scale Stochastic Optimization of NDCG Surrogates for Deep Learning with Provable Convergence

2022-02-24 · Zi-Hao Qiu, Quanqi Hu, Yongjian Zhong, Lijun Zhang 외

NDCG, namely Normalized Discounted Cumulative Gain, is a widely used ranking metric in information retrieval and machine learning. However, efficient and provable stochastic methods for maximizing NDCG are still lacking,…

Information RetrievalRetrievalStochastic Optimization

Optimizing Preference Alignment with Differentiable NDCG Ranking

2024-10-17 · Jiacong Zhou, Xianyun Wang, Jun Yu

Aligning large language models with human preferences improves interaction quality and safety by ensuring outputs better reflect human values. A promising strategy involves Reinforcement Learning from Human Feedback (RLH…

Learning-To-Rank

Breaking the Top-$K$ Barrier: Advancing Top-$K$ Ranking Metrics Optimization in Recommender Systems

2025-08-04 · Weiqin Yang, Jiawei Chen, Shengjia Zhang, Peng Wu 외 arxiv

In the realm of recommender systems (RS), Top-$K$ ranking metrics such as NDCG@$K$ are the gold standard for evaluating recommendation performance. However, during the training of recommendation models, optimizing NDCG@$…

Computational Efficiency