Data Augmentation with Manifold Exploring Geometric Transformations for Increased Performance and Robustness
In this paper we propose a novel augmentation technique that improves not only the performance of deep neural networks on clean test data, but also significantly increases their robustness to random transformations, both affine and projective. Inspired by ManiFool, the augmentation is performed by a line-search manifold-exploration method that learns affine geometric transformations that lead to the misclassification on an image, while ensuring that it remains on the same manifold as the training data. This augmentation method populates any training dataset with images that lie on the border of the manifolds between two-classes and maximizes the variance the network is exposed to during training. Our method was thoroughly evaluated on the challenging tasks of fine-grained skin lesion classification from limited data, and breast tumor classification of mammograms. Compared with traditional augmentation methods, and with images synthesized by Generative Adversarial Networks our method not only achieves state-of-the-art performance but also significantly improves the network's robustness.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationGeneral ClassificationLesion ClassificationSkin Lesion ClassificationSimilar Papers 제목 키워드 기반
PointManifoldCut: Point-wise Augmentation in the Manifold for Point Clouds
Mixed-based point cloud augmentation is a popular solution to the problem of limited availability of large-scale public datasets. But the mismatch between mixed points and corresponding semantic labels hinders the furthe…
Point Cloud ClassificationManitest: Are classifiers really invariant?
Invariance to geometric transformations is a highly desirable property of automatic classifiers in many image recognition tasks. Nevertheless, it is unclear to which extent state-of-the-art classifiers are invariant to b…
Data AugmentationTransfer Learning on Manifolds via Learned Transport Operators
Within-class variation in a high-dimensional dataset can be modeled as being on a low-dimensional manifold due to the constraints of the physical processes producing that variation (e.g., translation, illumination, etc.)…
Data AugmentationFew-Shot Image ClassificationGeneral ClassificationImage Animation+3Local Manifold Augmentation for Multiview Semantic Consistency
Multiview self-supervised representation learning roots in exploring semantic consistency across data of complex intra-class variation. Such variation is not directly accessible and therefore simulated by data augmentati…
Representation LearningSelf-Supervised LearningMGAug: Multimodal Geometric Augmentation in Latent Spaces of Image Deformations
Geometric transformations have been widely used to augment the size of training images. Existing methods often assume a unimodal distribution of the underlying transformations between images, which limits their power whe…
Image AugmentationMulti-class Classification