xAI-CycleGAN, a Cycle-Consistent Generative Assistive Network
In the domain of unsupervised image-to-image transformation using generative transformative models, CycleGAN has become the architecture of choice. One of the primary downsides of this architecture is its relatively slow rate of convergence. In this work, we use discriminator-driven explainability to speed up the convergence rate of the generative model by using saliency maps from the discriminator that mask the gradients of the generator during backpropagation, based on the work of Nagisetty et al., and also introducing the saliency map on input, added onto a Gaussian noise mask, by using an interpretable latent variable based on Wang M.'s Mask CycleGAN. This allows for an explainability fusion in both directions, and utilizing the noise-added saliency map on input as evidence-based counterfactual filtering. This new architecture has much higher rate of convergence than a baseline CycleGAN architecture while preserving the image quality.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualExplainable Artificial Intelligence (XAI)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Two-stage Complex Network using Cycle-consistent Generative Adversarial Networks for Speech Enhancement
Cycle-consistent generative adversarial networks (CycleGAN) have shown their promising performance for speech enhancement (SE), while one intractable shortcoming of these CycleGAN-based SE systems is that the noise compo…
DenoisingSpeech EnhancementSpeech Enhancement Based on Cyclegan with Noise-informed Training
Cycle-consistent generative adversarial networks (CycleGAN) were successfully applied to speech enhancement (SE) tasks with unpaired noisy-clean training data. The CycleGAN SE system adopted two generators and two discri…
Speech EnhancementPlasma-CycleGAN: Plasma Biomarker-Guided MRI to PET Cross-modality Translation Using Conditional CycleGAN
Cross-modality translation between MRI and PET imaging is challenging due to the distinct mechanisms underlying these modalities. Blood-based biomarkers (BBBMs) are revolutionizing Alzheimer's disease (AD) detection by i…
Image GenerationTranslationUnsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks
Recently, the cycle-consistent generative adversarial networks (CycleGAN) has been widely used for synthesis of multi-domain medical images. The domain-specific nonlinear deformations captured by CycleGAN make the synthe…
Image GenerationSemi-supervised MIMO Detection Using Cycle-consistent Generative Adversarial Network
In this paper, a new semi-supervised deep multiple-input multiple-output (MIMO) detection approach using a cycle-consistent generative adversarial network (CycleGAN) is proposed for communication systems without any prio…
Generative Adversarial Network