Evolving Image Compositions for Feature Representation Learning
Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing patches from pairs of images in a grid-like pattern. These new samples are assigned label scores that are proportional to the number of patches borrowed from each image. We then add a set of additional losses at the patch-level to regularize and to encourage good representations at both the patch and image levels. A ResNet-50 model trained on ImageNet using PatchMix exhibits superior transfer learning capabilities across a wide array of benchmarks. Although PatchMix can rely on random pairings and random grid-like patterns for mixing, we explore evolutionary search as a guiding strategy to jointly discover optimal grid-like patterns and image pairings. For this purpose, we conceive a fitness function that bypasses the need to re-train a model to evaluate each possible choice. In this way, PatchMix outperforms a base model on CIFAR-10 (+1.91), CIFAR-100 (+5.31), Tiny Imagenet (+3.52), and ImageNet (+1.16).
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationRepresentation LearningTransfer LearningSimilar Papers 제목 키워드 기반
Can we detect harmony in artistic compositions? A machine learning approach
Harmony in visual compositions is a concept that cannot be defined or easily expressed mathematically, even by humans. The goal of the research described in this paper was to find a numerical representation of artistic c…
BIG-bench Machine LearningCAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement
Compositional zero-shot learning (CZSL) aims to learn the concepts of attributes and objects in seen compositions and to recognize their unseen compositions. Most Contrastive Language-Image Pre-training (CLIP)-based CZSL…
Compositional Zero-Shot LearningDuplex: Dual Prototype Learning for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to enable models to recognize novel compositions of visual states and objects that were absent during training. Existing methods predominantly focus on learning semantic repre…
Compositional Zero-Shot LearningGraph Neural NetworkLearning Semantic RepresentationsPrompt Engineering+2Adaptive Data Augmentation for Contrastive Learning
In computer vision, contrastive learning is the most advanced unsupervised learning framework. Yet most previous methods simply apply fixed composition of data augmentations to improve data efficiency, which ignores the …
Contrastive LearningData AugmentationDecomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to recognize novel concepts formed by known states and objects during training. Existing methods either learn the combined state-object representation, challenging the general…
Compositional Zero-Shot LearningNovel ConceptsObjectZero-Shot Learning