Reliable Weakly Supervised Learning: Maximize Gain and Maintain Safeness
Weakly supervised data are widespread and have attracted much attention. However, since label quality is often difficult to guarantee, sometimes the use of weakly supervised data will lead to unsatisfactory performance, i.e., performance degradation or poor performance gains. Moreover, it is usually not feasible to manually increase the label quality, which results in weakly supervised learning being somewhat difficult to rely on. In view of this crucial issue, this paper proposes a simple and novel weakly supervised learning framework. We guide the optimization of label quality through a small amount of validation data, and to ensure the safeness of performance while maximizing performance gain. As validation set is a good approximation for describing generalization risk, it can effectively avoid the unsatisfactory performance caused by incorrect data distribution assumptions. We formalize this underlying consideration into a novel Bi-Level optimization and give an effective solution. Extensive experimental results verify that the new framework achieves impressive performance on weakly supervised learning with a small amount of validation data.
Code (0)
등록된 구현이 없습니다.
Tasks
Weakly-supervised LearningSimilar Papers 제목 키워드 기반
Contrastive Learning for Weakly Supervised Phrase Grounding
Phrase grounding, the problem of associating image regions to caption words, is a crucial component of vision-language tasks. We show that phrase grounding can be learned by optimizing word-region attention to maximize a…
Contrastive LearningLanguage ModelingLanguage ModellingPhrase GroundingGaIA: Graphical Information Gain based Attention Network for Weakly Supervised Point Cloud Semantic Segmentation
While point cloud semantic segmentation is a significant task in 3D scene understanding, this task demands a time-consuming process of fully annotating labels. To address this problem, recent studies adopt a weakly super…
Scene UnderstandingSegmentationSemantic SegmentationWeakly-supervised LearningTheoretical Guarantees of Deep Embedding Losses Under Label Noise
Collecting labeled data to train deep neural networks is costly and even impractical for many tasks. Thus, research effort has been focused in automatically curated datasets or unsupervised and weakly supervised learning…
TripletWeakly-supervised LearningWeDef: Weakly Supervised Backdoor Defense for Text Classification
Existing backdoor defense methods are only effective for limited trigger types. To defend different trigger types at once, we start from the class-irrelevant nature of the poisoning process and propose a novel weakly sup…
backdoor defenseClassificationtext-classificationText ClassificationWILDCAT: Weakly Supervised Learning of Deep ConvNets for Image Classification, Pointwise Localization and Segmentation
This paper introduces WILDCAT, a deep learning method which jointly aims at aligning image regions for gaining spatial invariance and learning strongly localized features. Our model is trained using only global image lab…
General Classificationimage-classificationImage ClassificationObject Localization+4