Shape Adaptor: A Learnable Resizing Module
We present a novel resizing module for neural networks: shape adaptor, a drop-in enhancement built on top of traditional resizing layers, such as pooling, bilinear sampling, and strided convolution. Whilst traditional resizing layers have fixed and deterministic reshaping factors, our module allows for a learnable reshaping factor. Our implementation enables shape adaptors to be trained end-to-end without any additional supervision, through which network architectures can be optimised for each individual task, in a fully automated way. We performed experiments across seven image classification datasets, and results show that by simply using a set of our shape adaptors instead of the original resizing layers, performance increases consistently over human-designed networks, across all datasets. Additionally, we show the effectiveness of shape adaptors on two other applications: network compression and transfer learning. The source code is available at: https://github.com/lorenmt/shape-adaptor.
Code (1)
Tasks
AutoMLimage-classificationImage ClassificationNeural Architecture SearchTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pooling Revisited: Your Receptive Field is Suboptimal
The size and shape of the receptive field determine how the network aggregates local information and affect the overall performance of a model considerably. Many components in a neural network, such as kernel sizes and s…
image-classificationImage ClassificationSemantic SegmentationMamba-Adaptor: State Space Model Adaptor for Visual Recognition
Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior per…
Inductive BiasMambaState Space ModelsTransfer LearningRGPNet: A Real-Time General Purpose Semantic Segmentation
We propose a real-time general purpose semantic segmentation architecture, RGPNet, which achieves significant performance gain in complex environments. RGPNet consists of a light-weight asymmetric encoder-decoder and an …
DecoderSegmentationSemantic SegmentationCorrAdaptor: Adaptive Local Context Learning for Correspondence Pruning
In the fields of computer vision and robotics, accurate pixel-level correspondences are essential for enabling advanced tasks such as structure-from-motion and simultaneous localization and mapping. Recent correspondence…
Graph LearningSimultaneous Localization and MappingStylePart: Image-based Shape Part Manipulation
Due to a lack of image-based "part controllers", shape manipulation of man-made shape images, such as resizing the backrest of a chair or replacing a cup handle is not intuitive. To tackle this problem, we present StyleP…
Attribute