paper-with-me

홈 › Papers

InterLUDE: Interactions between Labeled and Unlabeled Data to Enhance Semi-Supervised Learning

2024-03-15 · Zhe Huang, Xiaowei Yu, Dajiang Zhu, Michael C. Hughes

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification objective with a regularization term derived solely from unlabeled data. This formulation neglects the potential for interaction between labeled and unlabeled images. In this paper, we introduce InterLUDE, a new approach to enhance SSL made of two parts that each benefit from labeled-unlabeled interaction. The first part, embedding fusion, interpolates between labeled and unlabeled embeddings to improve representation learning. The second part is a new loss, grounded in the principle of consistency regularization, that aims to minimize discrepancies in the model's predictions between labeled versus unlabeled inputs. Experiments on standard closed-set SSL benchmarks and a medical SSL task with an uncurated unlabeled set show clear benefits to our approach. On the STL-10 dataset with only 40 labels, InterLUDE achieves 3.2% error rate, while the best previous method reports 14.9%.

📄 PDF Abstract BibTeX arXiv:2403.10658

Code (2)

Shawey94/ICML2024-InterLUDE 공식 구현 pytorch
Shawey94/NoisyNN pytorch

Tasks

image-classificationImage ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions

2021-04-06 · Jennifer J. Sun, Tomomi Karigo, Dipam Chakraborty, Sharada P. Mohanty 외

Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dat…

Style Transfer

Teacher Supervises Students How to Learn From Partially Labeled Images for Facial Landmark Detection

2019-08-06 · ICCV 2019 10 · Xuanyi Dong, Yi Yang

Facial landmark detection aims to localize the anatomically defined points of human faces. In this paper, we study facial landmark detection from partially labeled facial images. A typical approach is to (1) train a dete…

Facial Landmark Detection

Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagation

2023-05-25 · Yandan Zheng, Anran Hao, Anh Tuan Luu

Semi-supervised learning has been an important approach to address challenges in extracting entities and relations from limited data. However, current semi-supervised works handle the two tasks (i.e., Named Entity Recogn…

named-entity-recognitionNamed Entity RecognitionNERRelation+1

Exploring Semi-supervised Variational Autoencoders for Biomedical Relation Extraction

2019-01-18 · Yijia Zhang, Zhiyong Lu

The biomedical literature provides a rich source of knowledge such as protein-protein interactions (PPIs), drug-drug interactions (DDIs) and chemical-protein interactions (CPIs). Biomedical relation extraction aims to au…

DecoderRelationRelation Extraction

PI-GNN: Towards Robust Semi-Supervised Node Classification against Noisy Labels

2021-09-29 · Xuefeng Du, Tian Bian, Yu Rong, Bo Han 외

Semi-supervised node classification on graphs is a fundamental problem in graph mining that uses a small set of labeled nodes and many unlabeled nodes for training, so that its performance is quite sensitive to the quali…

Graph MiningGraph Neural NetworkNode Classification