paper-with-me

홈 › Papers

On the link between generative semi-supervised learning and generative open-set recognition

2023-03-21 · Emile Reyn Engelbrecht, Johan du Preez

This study investigates the relationship between semi-supervised learning (SSL, which is training off partially labelled datasets) and open-set recognition (OSR, which is classification with simultaneous novelty detection) under the context of generative adversarial networks (GANs). Although no previous study has formally linked SSL and OSR, their respective methods share striking similarities. Specifically, SSL-GANs and OSR-GANs require their generators to produce 'bad-looking' samples which are used to regularise their classifier networks. We hypothesise that the definitions of bad-looking samples in SSL and OSR represents the same concept and realises the same goal. More formally, bad-looking samples lie in the complementary space, which is the area between and around the boundaries of the labelled categories within the classifier's embedding space. By regularising a classifier with samples in the complementary space, classifiers achieve improved generalisation for SSL and also generalise the open space for OSR. To test this hypothesis, we compare a foundational SSL-GAN with the state-of-the-art OSR-GAN under the same SSL-OSR experimental conditions. Our results find that SSL-GANs achieve near identical results to OSR-GANs, proving the SSL-OSR link. Subsequently, to further this new research path, we compare several SSL-GANs various SSL-OSR setups which this first benchmark results. A combined framework of SSL-OSR certainly improves the practicality and cost-efficiency of classifier training, and so further theoretical and application studies are also discussed.

📄 PDF Abstract BibTeX arXiv:2303.11702

Code (0)

등록된 구현이 없습니다.

Tasks

Novelty DetectionOpen Set LearningSemi-supervised learning-open set recognition

Similar Papers 제목 키워드 기반

Generative Adversarial Networks: recent developments

2019-03-16 · Maciej Zamorski, Adrian Zdobylak, Maciej Zięba, Jerzy Świątek

In traditional generative modeling, good data representation is very often a base for a good machine learning model. It can be linked to good representations encoding more explanatory factors that are hidden in the origi…

BIG-bench Machine Learning

Random-walk Based Generative Model for Classifying Document Networks

2020-01-21 · Takafumi J. Suzuki

Document networks are found in various collections of real-world data, such as citation networks, hyperlinked web pages, and online social networks. A large number of generative models have been proposed because they off…

Topic Models

Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks

2015-11-19 · Jost Tobias Springenberg

In this paper we present a method for learning a discriminative classifier from unlabeled or partially labeled data. Our approach is based on an objective function that trades-off mutual information between observed exam…

ClusteringGeneral Classificationimage-classificationImage Classification+3

Good Semi-supervised VAE Requires Tighter Evidence Lower Bound

2019-09-25 · Haozhe Feng, Kezhi Kong, Tianye Zhang, Siyue Xue 외

Semi-supervised learning approaches based on generative models have now encountered 3 challenges: (1) The two-stage training strategy is not robust. (2) Good semi-supervised learning results and good generative performan…

4k

Semi-Supervised Learning with Deep Generative Models

2014-06-20 · NeurIPS 2014 12 · Diederik P. Kingma, Danilo J. Rezende, Shakir Mohamed, Max Welling

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. …

Bayesian Inference