Feedback Adversarial Learning: Spatial Feedback for Improving Generative Adversarial Networks
We propose feedback adversarial learning (FAL) framework that can improve existing generative adversarial networks by leveraging spatial feedback from the discriminator. We formulate the generation task as a recurrent framework, in which the discriminator's feedback is integrated into the feedforward path of the generation process. Specifically, the generator conditions on the discriminator's spatial output response, and its previous generation to improve generation quality over time - allowing the generator to attend and fix its previous mistakes. To effectively utilize the feedback, we propose an adaptive spatial transform layer, which learns to spatially modulate feature maps from its previous generation and the error signal from the discriminator. We demonstrate that one can easily adapt FAL to existing adversarial learning frameworks on a wide range of tasks, including image generation, image-to-image translation, and voxel generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedback
Learning from human feedback plays an important role in aligning generative models, such as large language models (LLM). However, the effectiveness of this approach can be influenced by adversaries, who may intentionally…
Neural Networks with Recurrent Generative Feedback
Neural networks are vulnerable to input perturbations such as additive noise and adversarial attacks. In contrast, human perception is much more robust to such perturbations. The Bayesian brain hypothesis states that hum…
Adversarial RobustnessGenerative Market Equilibrium Models with Stable Adversarial Learning via Reinforcement
We present a general computational framework for solving continuous-time financial market equilibria under minimal modeling assumptions while incorporating realistic financial frictions, such as trading costs, and suppor…
Deep Reinforcement LearningLearning Improvised Chatbots from Adversarial Modifications of Natural Language Feedback
The ubiquitous nature of chatbots and their interaction with users generate an enormous amount of data. Can we improve chatbots using this data? A self-feeding chatbot improves itself by asking natural language feedback …
ChatbotEnsemble Generative Cleaning with Feedback Loops for Defending Adversarial Attacks
Effective defense of deep neural networks against adversarial attacks remains a challenging problem, especially under powerful white-box attacks. In this paper, we develop a new method called ensemble generative cleaning…