paper-with-me

Papers

Interpretable Learning-to-Rank with Generalized Additive Models

2020-05-06 · Honglei Zhuang, Xuanhui Wang, Michael Bendersky, Alexander Grushetsky, Yonghui Wu, Petr Mitrichev, Ethan Sterling, Nathan Bell, Walker Ravina, Hai Qian

Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area. Recent progress on interpretable ranking models largely focuses on generating post-hoc explanations for existing black-box ranking models, whereas the alternative option of building an intrinsically interpretable ranking model with transparent and self-explainable structure remains unexplored. Developing fully-understandable ranking models is necessary in some scenarios (e.g., due to legal or policy constraints) where post-hoc methods cannot provide sufficiently accurate explanations. In this paper, we lay the groundwork for intrinsically interpretable learning-to-rank by introducing generalized additive models (GAMs) into ranking tasks. Generalized additive models (GAMs) are intrinsically interpretable machine learning models and have been extensively studied on regression and classification tasks. We study how to extend GAMs into ranking models which can handle both item-level and list-level features and propose a novel formulation of ranking GAMs. To instantiate ranking GAMs, we employ neural networks instead of traditional splines or regression trees. We also show that our neural ranking GAMs can be distilled into a set of simple and compact piece-wise linear functions that are much more efficient to evaluate with little accuracy loss. We conduct experiments on three data sets and show that our proposed neural ranking GAMs can achieve significantly better performance than other traditional GAM baselines while maintaining similar interpretability.

📄 PDF Abstract BibTeX arXiv:2005.02553

Code (0)

등록된 구현이 없습니다.

Tasks

Additive modelsInterpretable Machine LearningLearning-To-Rankregression

Methods 이 논문이 사용한 방법론

GAM 설명 없음

Similar Papers 제목 키워드 기반

Scalable Interpretability via Polynomials

2022-05-27 · Abhimanyu Dubey, Filip Radenovic, Dhruv Mahajan

Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalabili…

Additive modelsBIG-bench Machine LearningInterpretable Machine Learning

Beyond Additive Decompositions: Interpretability Through Separability

2026-05-29 · Jinyang Liu, Munir Eberhardt Hiabu arxiv

Interpretable machine learning requires models that are accurate and structurally faithful to the data. Existing explainability methods rely heavily on additive representations (e.g., Generalized Additive Models (GAMs), …

Interpretable Machine Learning

NODE-GAM: Neural Generalized Additive Model for Interpretable Deep Learning

2021-06-03 · ICLR 2022 4 · Chun-Hao Chang, Rich Caruana, Anna Goldenberg

Deployment of machine learning models in real high-risk settings (e.g. healthcare) often depends not only on the model's accuracy but also on its fairness, robustness, and interpretability. Generalized Additive Models (G…

Additive modelsDeep LearningFairnessSelf-Supervised Learning

GAMformer: In-Context Learning for Generalized Additive Models

2024-10-06 · Andreas Mueller, Julien Siems, Harsha Nori, David Salinas 외

Generalized Additive Models (GAMs) are widely recognized for their ability to create fully interpretable machine learning models for tabular data. Traditionally, training GAMs involves iterative learning algorithms, such…

Additive modelsIn-Context LearningInterpretable Machine Learning

Cluster-Based Generalized Additive Models Informed by Random Fourier Features

2025-12-22 · Xin Huang, Jia Li, Jun Yu arxiv

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work int…

Representation Learning