paper-with-me

Papers

Multi-Label Learning with Pairwise Relevance Ordering

2021-12-01 · NeurIPS 2021 12 · Ming-Kun Xie, Sheng-Jun Huang

Precisely annotating objects with multiple labels is costly and has become a critical bottleneck in real-world multi-label classification tasks. Instead, deciding the relative order of label pairs is obviously less laborious than collecting exact labels. However, the supervised information of pairwise relevance ordering is less informative than exact labels. It is thus an important challenge to effectively learn with such weak supervision. In this paper, we formalize this problem as a novel learning framework, called multi-label learning with pairwise relevance ordering (PRO). We show that the unbiased estimator of classification risk can be derived with a cost-sensitive loss only from PRO examples. Theoretically, we provide the estimation error bound for the proposed estimator and further prove that it is consistent with respective to the commonly used ranking loss. Empirical studies on multiple datasets and metrics validate the effectiveness of the proposed method.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label Learning

Similar Papers 제목 키워드 기반

Learning Groupwise Multivariate Scoring Functions Using Deep Neural Networks

2018-11-11 · Qingyao Ai, Xuanhui Wang, Sebastian Bruch, Nadav Golbandi 외

While in a classification or a regression setting a label or a value is assigned to each individual document, in a ranking setting we determine the relevance ordering of the entire input document list. This difference le…

Learning-To-Rank

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

2024-04-17 · Le Yan, Zhen Qin, Honglei Zhuang, Rolf Jagerman 외

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevan…

Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings

2021-10-13 · EMNLP 2021 11 · Shaopeng Lai, Ante Wang, Fandong Meng, Jie zhou 외

Dominant sentence ordering models can be classified into pairwise ordering models and set-to-sequence models. However, there is little attempt to combine these two types of models, which inituitively possess complementar…

SentenceSentence Ordering

Learning Household Task Knowledge from WikiHow Descriptions

2019-09-13 · WS 2019 8 · Yilun Zhou, Julie A. Shah, Steven Schockaert

Commonsense procedural knowledge is important for AI agents and robots that operate in a human environment. While previous attempts at constructing procedural knowledge are mostly rule- and template-based, recent advance…

Articles

Integrating Listwise Ranking into Pairwise-based Image-Text Retrieval

2023-05-26 · Zheng Li, Caili Guo, Xin Wang, Zerun Feng 외

Image-Text Retrieval (ITR) is essentially a ranking problem. Given a query caption, the goal is to rank candidate images by relevance, from large to small. The current ITR datasets are constructed in a pairwise manner. I…

Image-text RetrievalRetrievalText RetrievalTriplet