paper-with-me

홈 › Papers

PDL: Regularizing Multiple Instance Learning with Progressive Dropout Layers

2023-08-19 · Wenhui Zhu, Peijie Qiu, Xiwen Chen, Oana M. Dumitrascu, Yalin Wang

Multiple instance learning (MIL) was a weakly supervised learning approach that sought to assign binary class labels to collections of instances known as bags. However, due to their weak supervision nature, the MIL methods were susceptible to overfitting and required assistance in developing comprehensive representations of target instances. While regularization typically effectively combated overfitting, its integration with the MIL model has been frequently overlooked in prior studies. Meanwhile, current regularization methods for MIL have shown limitations in their capacity to uncover a diverse array of representations. In this study, we delve into the realm of regularization within the MIL model, presenting a novel approach in the form of a Progressive Dropout Layer (PDL). We aim to not only address overfitting but also empower the MIL model in uncovering intricate and impactful feature representations. The proposed method was orthogonal to existing MIL methods and could be easily integrated into them to boost performance. Our extensive evaluation across a range of MIL benchmark datasets demonstrated that the incorporation of the PDL into multiple MIL methods not only elevated their classification performance but also augmented their potential for weakly-supervised feature localizations.

📄 PDF Abstract BibTeX arXiv:2308.10112

Code (1)

chongqingnosubway/pdl 공식 구현 pytorch

Tasks

Multiple Instance LearningWeakly Supervised ClassificationWeakly-supervised LearningWeakly Supervised Object Detectionwhole slide images

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

An Exploration of Dropout with RNNs for Natural Language Inference

2018-10-22 · Amit Gajbhiye, Sardar Jaf, Noura Al Moubayed, A. Stephen McGough 외

Dropout is a crucial regularization technique for the Recurrent Neural Network (RNN) models of Natural Language Inference (NLI). However, dropout has not been evaluated for the effectiveness at different layers and dropo…

Natural Language Inference

Adaptive Dropout: Unleashing Dropout across Layers for Generalizable Image Super-Resolution

2025-01-01 · CVPR 2025 1 · Hang Xu, Jie Huang, Wei Yu, Jiangtong Tan 외

Blind Super-Resolution(blind SR) aims to enhance the model's generalization ability with unknown degradation, yet it still encounters severe overfitting issues. Some previous methods inspired by dropout, which enhanc…

AttributeBlind Super-ResolutionImage RestorationImage Super-Resolution+1

Regularization of Neural Networks using DropConnect

2013-06-13 · ICML'13: Proceedings of the 30th International Conference on International Conference on Machine Learning - Volume 28 2013 6 · Li Wan, Matthew Zeiler, Sixin Zhang, Yann Lecun 외

We introduce DropConnect, a generalization of Dropout (Hinton et al., 2012), for regularizing large fully-connected layers within neural networks. When training with Dropout, a randomly selected subset of activations are…

Image Classification

PLACE dropout: A Progressive Layer-wise and Channel-wise Dropout for Domain Generalization

2021-12-07 · Jintao Guo, Lei Qi, Yinghuan Shi, Yang Gao

Domain generalization (DG) aims to learn a generic model from multiple observed source domains that generalizes well to arbitrary unseen target domains without further training. The major challenge in DG is that the mode…

Domain Generalization

DropBlock: A regularization method for convolutional networks

2018-10-30 · NeurIPS 2018 12 · Golnaz Ghiasi, Tsung-Yi Lin, Quoc V. Le

Deep neural networks often work well when they are over-parameterized and trained with a massive amount of noise and regularization, such as weight decay and dropout. Although dropout is widely used as a regularization t…

Image ClassificationObject Detection