Learning Discriminators as Energy Networks in Adversarial Learning
We propose a novel framework for structured prediction via adversarial learning. Existing adversarial learning methods involve two separate networks, i.e., the structured prediction models and the discriminative models, in the training. The information captured by discriminative models complements that in the structured prediction models, but few existing researches have studied on utilizing such information to improve structured prediction models at the inference stage. In this work, we propose to refine the predictions of structured prediction models by effectively integrating discriminative models into the prediction. Discriminative models are treated as energy-based models. Similar to the adversarial learning, discriminative models are trained to estimate scores which measure the quality of predicted outputs, while structured prediction models are trained to predict contrastive outputs with maximal energy scores. In this way, the gradient vanishing problem is ameliorated, and thus we are able to perform inference by following the ascent gradient directions of discriminative models to refine structured prediction models. The proposed method is able to handle a range of tasks, e.g., multi-label classification and image segmentation. Empirical results on these two tasks validate the effectiveness of our learning method.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPredictionSemantic SegmentationStructured PredictionSimilar Papers 제목 키워드 기반
Re-using Adversarial Mask Discriminators for Test-time Training under Distribution Shifts
Thanks to their ability to learn flexible data-driven losses, Generative Adversarial Networks (GANs) are an integral part of many semi- and weakly-supervised methods for medical image segmentation. GANs jointly optimise …
Continual LearningImage ReconstructionImage SegmentationMedical Image Segmentation+1Adversarial Energy Disaggregation for Non-intrusive Load Monitoring
Energy disaggregation, also known as non-intrusive load monitoring (NILM), challenges the problem of separating the whole-home electricity usage into appliance-specific individual consumptions, which is a typical applica…
Non-Intrusive Load MonitoringOn-line Adaptative Curriculum Learning for GANs
Generative Adversarial Networks (GANs) can successfully approximate a probability distribution and produce realistic samples. However, open questions such as sufficient convergence conditions and mode collapse still pers…
Multi-Armed BanditsStochastic OptimizationStop Throwing Away Discriminators! Re-using Adversaries for Test-Time Training
Thanks to their ability to learn data distributions without requiring paired data, Generative Adversarial Networks (GANs) have become an integral part of many computer vision methods, including those developed for medica…
Image SegmentationMedical Image SegmentationSemantic SegmentationMCL-GAN: Generative Adversarial Networks with Multiple Specialized Discriminators
We propose a framework of generative adversarial networks with multiple discriminators, which collaborate to represent a real dataset more effectively. Our approach facilitates learning a generator consistent with the un…
Generative Adversarial NetworkMultiple-choice