paper-with-me

홈 › Papers

Navigating Beyond Dropout: An Intriguing Solution Towards Generalizable Image Super Resolution

2024-02-29 · CVPR 2024 1 · Hongjun Wang, Jiyuan Chen, Yinqiang Zheng, Tieyong Zeng

Deep learning has led to a dramatic leap on Single Image Super-Resolution (SISR) performances in recent years. %Despite the substantial advancement% While most existing work assumes a simple and fixed degradation model (e.g., bicubic downsampling), the research of Blind SR seeks to improve model generalization ability with unknown degradation. Recently, Kong et al pioneer the investigation of a more suitable training strategy for Blind SR using Dropout. Although such method indeed brings substantial generalization improvements via mitigating overfitting, we argue that Dropout simultaneously introduces undesirable side-effect that compromises model's capacity to faithfully reconstruct fine details. We show both the theoretical and experimental analyses in our paper, and furthermore, we present another easy yet effective training strategy that enhances the generalization ability of the model by simply modulating its first and second-order features statistics. Experimental results have shown that our method could serve as a model-agnostic regularization and outperforms Dropout on seven benchmark datasets including both synthetic and real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2402.18929

Code (0)

등록된 구현이 없습니다.

Tasks

Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Beyond Overfitting: Doubly Adaptive Dropout for Generalizable AU Detection

2025-03-12 · Yong Li, Yi Ren, Xuesong Niu, Yi Ding 외

Facial Action Units (AUs) are essential for conveying psychological states and emotional expressions. While automatic AU detection systems leveraging deep learning have progressed, they often overfit to specific datasets…

Variational Inference-Based Dropout in Recurrent Neural Networks for Slot Filling in Spoken Language Understanding

2020-08-23 · Jun Qi, Xu Liu, Javier Tejedor

This paper proposes to generalize the variational recurrent neural network (RNN) with variational inference (VI)-based dropout regularization employed for the long short-term memory (LSTM) cells to more advanced RNN arch…

slot-fillingSlot FillingSpoken Language UnderstandingVariational Inference

Adaptive Dropout: Unleashing Dropout across Layers for Generalizable Image Super-Resolution

2025-01-01 · CVPR 2025 1 · Hang Xu, Jie Huang, Wei Yu, Jiangtong Tan 외

Blind Super-Resolution(blind SR) aims to enhance the model's generalization ability with unknown degradation, yet it still encounters severe overfitting issues. Some previous methods inspired by dropout, which enhanc…

AttributeBlind Super-ResolutionImage RestorationImage Super-Resolution+1

How Effective Can Dropout Be in Multiple Instance Learning ?

2025-04-21 · Wenhui Zhu, Peijie Qiu, Xiwen Chen, Zhangsihao Yang 외

Multiple Instance Learning (MIL) is a popular weakly-supervised method for various applications, with a particular interest in histological whole slide image (WSI) classification. Due to the gigapixel resolution of WSI, …

Multiple Instance Learning

FedDropoutAvg: Generalizable federated learning for histopathology image classification

2021-11-25 · Gozde N. Gunesli, Mohsin Bilal, Shan E Ahmed Raza, Nasir M. Rajpoot

Federated learning (FL) enables collaborative learning of a deep learning model without sharing the data of participating sites. FL in medical image analysis tasks is relatively new and open for enhancements. In this stu…

ClassificationFederated Learningimage-classificationImage Classification+1