paper-with-me

홈 › Papers

Channel DropBlock: An Improved Regularization Method for Fine-Grained Visual Classification

2021-06-07 · Yifeng Ding, Shuwei Dong, Yujun Tong, Zhanyu Ma, Bo Xiao, Haibin Ling

Classifying the sub-categories of an object from the same super-category (e.g., bird) in a fine-grained visual classification (FGVC) task highly relies on mining multiple discriminative features. Existing approaches mainly tackle this problem by introducing attention mechanisms to locate the discriminative parts or feature encoding approaches to extract the highly parameterized features in a weakly-supervised fashion. In this work, we propose a lightweight yet effective regularization method named Channel DropBlock (CDB), in combination with two alternative correlation metrics, to address this problem. The key idea is to randomly mask out a group of correlated channels during training to destruct features from co-adaptations and thus enhance feature representations. Extensive experiments on three benchmark FGVC datasets show that CDB effectively improves the performance.

📄 PDF Abstract BibTeX arXiv:2106.03432

Code (0)

등록된 구현이 없습니다.

Tasks

Fine-Grained Image Classification

Methods 이 논문이 사용한 방법론

DropBlock DropBlock is a structured form of dropout directed at regularizing convolutional networks. In DropBlock, units in a contiguous…

Similar Papers 제목 키워드 기반

DropBlock: A regularization method for convolutional networks

2018-10-30 · NeurIPS 2018 12 · Golnaz Ghiasi, Tsung-Yi Lin, Quoc V. Le

Deep neural networks often work well when they are over-parameterized and trained with a massive amount of noise and regularization, such as weight decay and dropout. Although dropout is widely used as a regularization t…

Image ClassificationObject Detection

Revisiting Structured Dropout

2022-10-05 · Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins

Large neural networks are often overparameterised and prone to overfitting, Dropout is a widely used regularization technique to combat overfitting and improve model generalization. However, unstructured Dropout is not a…

Scheduling

AutoDropout: Learning Dropout Patterns to Regularize Deep Networks

2021-01-05 · Hieu Pham, Quoc V. Le

Neural networks are often over-parameterized and hence benefit from aggressive regularization. Conventional regularization methods, such as Dropout or weight decay, do not leverage the structures of the network's inputs …

Image ClassificationLanguage ModelingLanguage ModellingMachine Translation

On the Regularization Properties of Structured Dropout

2019-10-30 · CVPR 2020 6 · Ambar Pal, Connor Lane, René Vidal, Benjamin D. Haeffele

Dropout and its extensions (eg. DropBlock and DropConnect) are popular heuristics for training neural networks, which have been shown to improve generalization performance in practice. However, a theoretical understandin…

Dual-attention Guided Dropblock Module for Weakly Supervised Object Localization

2020-03-09 · Junhui Yin, Siqing Zhang, Dongliang Chang, Zhanyu Ma 외

Attention mechanisms is frequently used to learn the discriminative features for better feature representations. In this paper, we extend the attention mechanism to the task of weakly supervised object localization (WSOL…

Object LocalizationWeakly-Supervised Object Localization