paper-with-me

홈 › Papers

Learning from Complementary Labels

2017-05-22 · NeurIPS 2017 12 · Takashi Ishida, Gang Niu, Weihua Hu, Masashi Sugiyama

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A complementary label specifies a class that a pattern does not belong to. Collecting complementary labels would be less laborious than collecting ordinary labels, since users do not have to carefully choose the correct class from a long list of candidate classes. However, complementary labels are less informative than ordinary labels and thus a suitable approach is needed to better learn from them. In this paper, we show that an unbiased estimator to the classification risk can be obtained only from complementarily labeled data, if a loss function satisfies a particular symmetric condition. We derive estimation error bounds for the proposed method and prove that the optimal parametric convergence rate is achieved. We further show that learning from complementary labels can be easily combined with learning from ordinary labels (i.e., ordinary supervised learning), providing a highly practical implementation of the proposed method. Finally, we experimentally demonstrate the usefulness of the proposed methods.

📄 PDF Abstract BibTeX arXiv:1705.07541

Code (1)

takashiishida/comp pytorch

Tasks

ClassificationGeneral ClassificationMulti-class Classification

Similar Papers 제목 키워드 기반

Learning with Biased Complementary Labels

2017-11-27 · ECCV 2018 9 · Xiyu Yu, Tongliang Liu, Mingming Gong, DaCheng Tao

In this paper, we study the classification problem in which we have access to easily obtainable surrogate for true labels, namely complementary labels, which specify classes that observations do \textbf{not} belong to. L…

Enhancing Label Sharing Efficiency in Complementary-Label Learning with Label Augmentation

2023-05-15 · Wei-I Lin, Gang Niu, Hsuan-Tien Lin, Masashi Sugiyama

Complementary-label Learning (CLL) is a form of weakly supervised learning that trains an ordinary classifier using only complementary labels, which are the classes that certain instances do not belong to. While existing…

Weakly-supervised Learning

Generative-Discriminative Complementary Learning

2019-04-02 · Yanwu Xu, Mingming Gong, Junxiang Chen, Tongliang Liu 외

Majority of state-of-the-art deep learning methods are discriminative approaches, which model the conditional distribution of labels given inputs features. The success of such approaches heavily depends on high-quality l…

Robust Loss Functions for Complementary Labels Learning

2021-01-01 · Defu Liu, Guowu Yang

In ordinary-label learning, the correct label is given to each training sample. Similarly, a complementary label is also provided for each training sample in complementary-label learning. A complementary label indicates …

Multi-Complementary and Unlabeled Learning for Arbitrary Losses and Models

2020-01-13 · Yuzhou Cao, Shuqi Liu, Yitian Xu

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not…

General ClassificationImage ClassificationWeakly-supervised Learning