paper-with-me

홈 › Papers

Patch Reordering: a Novel Way to Achieve Rotation and Translation Invariance in Convolutional Neural Networks

2019-11-28 · Xu Shen, Xinmei Tian, Shaoyan Sun, DaCheng Tao

Convolutional Neural Networks (CNNs) have demonstrated state-of-the-art performance on many visual recognition tasks. However, the combination of convolution and pooling operations only shows invariance to small local location changes in meaningful objects in input. Sometimes, such networks are trained using data augmentation to encode this invariance into the parameters, which restricts the capacity of the model to learn the content of these objects. A more efficient use of the parameter budget is to encode rotation or translation invariance into the model architecture, which relieves the model from the need to learn them. To enable the model to focus on learning the content of objects other than their locations, we propose to conduct patch ranking of the feature maps before feeding them into the next layer. When patch ranking is combined with convolution and pooling operations, we obtain consistent representations despite the location of meaningful objects in input. We show that the patch ranking module improves the performance of the CNN on many benchmark tasks, including MNIST digit recognition, large-scale image recognition, and image retrieval. The code is available at https://github.com//jasonustc/caffe-multigpu/tree/TICNN .

📄 PDF Abstract BibTeX arXiv:1911.12682

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationImage RetrievalRetrievalTranslation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Are the Latent Representations of Foundation Models for Pathology Invariant to Rotation?

2024-12-16 · Matouš Elphick, Samra Turajlic, Guang Yang

Self-supervised foundation models for digital pathology encode small patches from H\&E whole slide images into latent representations used for downstream tasks. However, the invariance of these representations to patch r…

Inductive Biaswhole slide images

Patch Attack Invariance: How Sensitive are Patch Attacks to 3D Pose?

2021-08-16 · Max Lennon, Nathan Drenkow, Philippe Burlina

Perturbation-based attacks, while not physically realizable, have been the main emphasis of adversarial machine learning (ML) research. Patch-based attacks by contrast are physically realizable, yet most work has focused…

Rotation Invariance Neural Network

2017-06-17 · Shiyuan Li

Rotation invariance and translation invariance have great values in image recognition tasks. In this paper, we bring a new architecture in convolutional neural network (CNN) named cyclic convolutional layer to achieve ro…

One-Shot LearningPositionTranslation

On Universalized Adversarial and Invariant Perturbations

2020-06-08 · Sandesh Kamath, Amit Deshpande, K V Subrahmanyam

Convolutional neural networks or standard CNNs (StdCNNs) are translation-equivariant models that achieve translation invariance when trained on data augmented with sufficient translations. Recent work on equivariant mode…

Translation

PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration

2023-02-06 · Dingxin Zhang, Jianhui Yu, Chaoyi Zhang, Weidong Cai

Recent interest in point cloud analysis has led rapid progress in designing deep learning methods for 3D models. However, state-of-the-art models are not robust to rotations, which remains an unknown prior to real applic…

3D Object ClassificationDisentanglement