paper-with-me

홈 › Papers

OpenMatch: Open-Set Semi-supervised Learning with Open-set Consistency Regularization

2021-12-01 · NeurIPS 2021 12 · Kuniaki Saito, Donghyun Kim, Kate Saenko

Semi-supervised learning (SSL) is an effective means to leverage unlabeled data to improve a model’s performance. Typical SSL methods like FixMatch assume that labeled and unlabeled data share the same label space. However, in practice, unlabeled data can contain categories unseen in the labeled set, i.e., outliers, which can significantly harm the performance of SSL algorithms. To address this problem, we propose a novel Open-set Semi-Supervised Learning (OSSL) approach called OpenMatch.Learning representations of inliers while rejecting outliers is essential for the success of OSSL. To this end, OpenMatch unifies FixMatch with novelty detection based on one-vs-all (OVA) classifiers. The OVA-classifier outputs the confidence score of a sample being an inlier, providing a threshold to detect outliers. Another key contribution is an open-set soft-consistency regularization loss, which enhances the smoothness of the OVA-classifier with respect to input transformations and greatly improves outlier detection. \ours achieves state-of-the-art performance on three datasets, and even outperforms a fully supervised model in detecting outliers unseen in unlabeled data on CIFAR10. The code is available at \url{https://github.com/VisionLearningGroup/OP_Match}.

📄 PDF Abstract BibTeX

Code (1)

VisionLearningGroup/OP_Match 공식 구현 pytorch

Tasks

Novelty DetectionOutlier DetectionSemi-Supervised Image Classification

Methods 이 논문이 사용한 방법론

FixMatch FixMatch is an algorithm that first generates pseudo-labels using the model's predictions on weakly-augmented unlabeled images. For a given image, the pseudo-label is only…

Similar Papers 제목 키워드 기반

OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers

2021-05-28 · Kuniaki Saito, Donghyun Kim, Kate Saenko

Semi-supervised learning (SSL) is an effective means to leverage unlabeled data to improve a model's performance. Typical SSL methods like FixMatch assume that labeled and unlabeled data share the same label space. Howev…

Novelty DetectionOutlier Detection

OpenMatch: An Open Source Library for Neu-IR Research

2021-01-30 · Zhenghao Liu, Kaitao Zhang, Chenyan Xiong, Zhiyuan Liu 외

OpenMatch is a Python-based library that serves for Neural Information Retrieval (Neu-IR) research. It provides self-contained neural and traditional IR modules, making it easy to build customized and higher-capacity IR …

Document RankingInformation RetrievalRetrieval

Prompt-driven efficient Open-set Semi-supervised Learning

2022-09-28 · Haoran Li, Chun-Mei Feng, Tao Zhou, Yong Xu 외

Open-set semi-supervised learning (OSSL) has attracted growing interest, which investigates a more practical scenario where out-of-distribution (OOD) samples are only contained in unlabeled data. Existing OSSL methods li…

Computational EfficiencyOutlier DetectionPrompt Learning

Unsupervised Learning for Class Distribution Mismatch

2025-05-11 · Pan Du, Wangbo Zhao, Xinai Lu, Nian Liu 외

Class distribution mismatch (CDM) refers to the discrepancy between class distributions in training data and target tasks. Previous methods address this by designing classifiers to categorize classes known during trainin…

OwMatch: Conditional Self-Labeling with Consistency for Open-World Semi-Supervised Learning

2024-11-04 · Shengjie Niu, Lifan Lin, Jian Huang, Chao Wang

Semi-supervised learning (SSL) offers a robust framework for harnessing the potential of unannotated data. Traditionally, SSL mandates that all classes possess labeled instances. However, the emergence of open-world SSL …

Open-World Semi-Supervised Learning