PatchShuffle Regularization
This paper focuses on regularizing the training of the convolutional neural
network (CNN). We propose a new regularization approach named `PatchShuffle`
that can be adopted in any classification-oriented CNN models. It is easy to
implement: in each mini-batch, images or feature maps are randomly chosen to
undergo a transformation such that pixels within each local patch are shuffled.
Through generating images and feature maps with interior orderless patches,
PatchShuffle creates rich local variations, reduces the risk of network
overfitting, and can be viewed as a beneficial supplement to various kinds of
training regularization techniques, such as weight decay, model ensemble and
dropout. Experiments on four representative classification datasets show that
PatchShuffle improves the generalization ability of CNN especially when the
data is scarce. Moreover, we empirically illustrate that CNN models trained
with PatchShuffle are more robust to noise and local changes in an image.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationSimilar Papers 제목 키워드 기반
Training Vision Transformers for Semi-Supervised Semantic Segmentation
We present S4Former a novel approach to training Vision Transformers for Semi-Supervised Semantic Segmentation (S4). At its core S4Former employs a Vision Transformer within a classic teacher-student framework and th…
Semantic SegmentationSemi-Supervised Semantic SegmentationSFLD: Reducing the content bias for AI-generated Image Detection
Identifying AI-generated content is critical for the safe and ethical use of generative AI. Recent research has focused on developing detectors that generalize to unknown generators, with popular methods relying either o…
DiversityBadViM: Backdoor Attack against Vision Mamba
Vision State Space Models (SSMs), particularly architectures like Vision Mamba (ViM), have emerged as promising alternatives to Vision Transformers (ViTs). However, the security implications of this novel architecture, e…
Adaptive and Implicit Regularization for Matrix Completion
The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image proces…
Matrix CompletionAIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion
The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image proces…
Matrix CompletionMissing Elements