paper-with-me

홈 › Papers

Enhancing GANs with Contrastive Learning-Based Multistage Progressive Finetuning SNN and RL-Based External Optimization

2024-09-30 · Osama Mustafa

Generative Adversarial Networks (GANs) have been at the forefront of image synthesis, especially in medical fields like histopathology, where they help address challenges such as data scarcity, patient privacy, and class imbalance. However, several inherent and domain-specific issues remain. For GANs, training instability, mode collapse, and insufficient feedback from binary classification can undermine performance. These challenges are particularly pronounced with high-resolution histopathology images due to their complex feature representation and high spatial detail. In response to these challenges, this work proposes a novel framework integrating a contrastive learning-based Multistage Progressive Finetuning Siamese Neural Network (MFT-SNN) with a Reinforcement Learning-based External Optimizer (RL-EO). The MFT-SNN improves feature similarity extraction in histopathology data, while the RL-EO acts as a reward-based guide to balance GAN training, addressing mode collapse and enhancing output quality. The proposed approach is evaluated against state-of-the-art (SOTA) GAN models and demonstrates superior performance across multiple metrics.

📄 PDF Abstract BibTeX arXiv:2409.20340

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationContrastive LearningDenoisingImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Risk Minimization, Regret Minimization and Progressive Hedging Algorithms

2020-06-14

This paper begins with a study on the dual representations of risk and regret measures and their impact on modeling multistage decision making under uncertainty. A relationship between risk envelopes and regret envelopes…

Decision MakingDecision Making Under Uncertainty

Efficient NLP Model Finetuning via Multistage Data Filtering

2022-07-28 · Xu Ouyang, Shahina Mohd Azam Ansari, Felix Xiaozhu Lin, Yangfeng Ji

As model finetuning is central to the modern NLP, we set to maximize its efficiency. Motivated by redundancy in training examples and the sheer sizes of pretrained models, we exploit a key opportunity: training only on i…

Classificationmodeltext-classificationText Classification

Exploring the Effectiveness of Multi-stage Fine-tuning for Cross-encoder Re-rankers

2025-03-28 · Francesca Pezzuti, Sean MacAvaney, Nicola Tonellotto

State-of-the-art cross-encoders can be fine-tuned to be highly effective in passage re-ranking. The typical fine-tuning process of cross-encoders as re-rankers requires large amounts of manually labelled data, a contrast…

Contrastive LearningLanguage ModelingLanguage ModellingLarge Language Model+2

Progressive Generative Adversarial Networks for Medical Image Super resolution

2019-02-06 · Dwarikanath Mahapatra, Behzad Bozorgtabar

Anatomical landmark segmentation and pathology localization are important steps in automated analysis of medical images. They are particularly challenging when the anatomy or pathology is small, as in retinal images and …

AnatomyImage Super-ResolutionSuper-ResolutionTriplet

Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement

2024-04-15 · Chi Wang, Junming Huang, Rong Zhang, Qi Wang 외

Automatic 3D facial texture generation has gained significant interest recently. Existing approaches may not support the traditional physically based rendering pipeline or rely on 3D data captured by Light Stage. Our key…

DiversityTexture Synthesis