A Self-attention Guided Multi-scale Gradient GAN for Diversified X-ray Image Synthesis
Imbalanced image datasets are commonly available in the domain of biomedical image analysis. Biomedical images contain diversified features that are significant in predicting targeted diseases. Generative Adversarial Networks (GANs) are utilized to address the data limitation problem via the generation of synthetic images. Training challenges such as mode collapse, non-convergence, and instability degrade a GAN's performance in synthesizing diversified and high-quality images. In this work, MSG-SAGAN, an attention-guided multi-scale gradient GAN architecture is proposed to model the relationship between long-range dependencies of biomedical image features and improves the training performance using a flow of multi-scale gradients at multiple resolutions in the layers of generator and discriminator models. The intent is to reduce the impact of mode collapse and stabilize the training of GAN using an attention mechanism with multi-scale gradient learning for diversified X-ray image synthesis. Multi-scale Structural Similarity Index Measure (MS-SSIM) and Frechet Inception Distance (FID) are used to identify the occurrence of mode collapse and evaluate the diversity of synthetic images generated. The proposed architecture is compared with the multi-scale gradient GAN (MSG-GAN) to assess the diversity of generated synthetic images. Results indicate that the MSG-SAGAN outperforms MSG-GAN in synthesizing diversified images as evidenced by the MS-SSIM and FID scores.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityImage GenerationMS-SSIMSSIMSimilar Papers 제목 키워드 기반
Gradient-Guided Multiscale Focal Attention Network for Remote Sensing Scene Classification
Remote sensing scene classification (RSSC) aims to understand and analyze the semantic information at the scene level with complex geographical properties. Despite the profound success of advanced deep models in automati…
Aerial Scene ClassificationRemote Sensing Image ClassificationScene ClassificationAttention Guided CAM: Visual Explanations of Vision Transformer Guided by Self-Attention
Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper…
MATEX: Multi-scale Attention and Text-guided Explainability of Medical Vision-Language Models
We introduce MATEX (Multi-scale Attention and Text-guided Explainability), a novel framework that advances interpretability in medical vision-language models by incorporating anatomically informed spatial reasoning. MATE…
Spatial ReasoningSelf-Supervised Multi-Scale Transformer with Attention-Guided Fusion for Efficient Crack Detection
Pavement crack detection has long depended on costly and time-intensive pixel-level annotations, which limit its scalability for large-scale infrastructure monitoring. To overcome this barrier, this paper examines the fe…
Self-Supervised LearningCrack SegmentationEGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimation
The ubiquitous multi-camera setup on modern autonomous vehicles provides an opportunity to construct surround-view depth. Existing methods, however, either perform independent monocular depth estimations on each camera o…
Autonomous DrivingAutonomous VehiclesDepth Estimation