paper-with-me

Papers

Evolving Image Compositions for Feature Representation Learning

2021-06-16 · Paola Cascante-Bonilla, Arshdeep Sekhon, Yanjun Qi, Vicente Ordonez

Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing patches from pairs of images in a grid-like pattern. These new samples are assigned label scores that are proportional to the number of patches borrowed from each image. We then add a set of additional losses at the patch-level to regularize and to encourage good representations at both the patch and image levels. A ResNet-50 model trained on ImageNet using PatchMix exhibits superior transfer learning capabilities across a wide array of benchmarks. Although PatchMix can rely on random pairings and random grid-like patterns for mixing, we explore evolutionary search as a guiding strategy to jointly discover optimal grid-like patterns and image pairings. For this purpose, we conceive a fitness function that bypasses the need to re-train a model to evaluate each possible choice. In this way, PatchMix outperforms a base model on CIFAR-10 (+1.91), CIFAR-100 (+5.31), Tiny Imagenet (+3.52), and ImageNet (+1.16).

📄 PDF Abstract BibTeX arXiv:2106.09011

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationRepresentation LearningTransfer Learning

Similar Papers 제목 키워드 기반

Can we detect harmony in artistic compositions? A machine learning approach

2020-12-10 · Adam Vandor, Marie van Vollenhoven, Gerhard Weiss, Gerasimos Spanakis

Harmony in visual compositions is a concept that cannot be defined or easily expressed mathematically, even by humans. The goal of the research described in this paper was to find a numerical representation of artistic c…

BIG-bench Machine Learning

CAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement

2025-11-20 · Pan Yang, Cheng Deng, Jing Yang, Han Zhao 외 arxiv

Compositional zero-shot learning (CZSL) aims to learn the concepts of attributes and objects in seen compositions and to recognize their unseen compositions. Most Contrastive Language-Image Pre-training (CLIP)-based CZSL…

Compositional Zero-Shot Learning

Duplex: Dual Prototype Learning for Compositional Zero-Shot Learning

2025-01-13 · Zhong Peng, Yishi Xu, Gerong Wang, Wenchao Chen 외

Compositional Zero-Shot Learning (CZSL) aims to enable models to recognize novel compositions of visual states and objects that were absent during training. Existing methods predominantly focus on learning semantic repre…

Compositional Zero-Shot LearningGraph Neural NetworkLearning Semantic RepresentationsPrompt Engineering+2

Adaptive Data Augmentation for Contrastive Learning

2023-04-05 · Yuhan Zhang, He Zhu, Shan Yu

In computer vision, contrastive learning is the most advanced unsupervised learning framework. Yet most previous methods simply apply fixed composition of data augmentations to improve data efficiency, which ignores the …

Contrastive LearningData Augmentation

Decomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learning

2022-11-19 · CVPR 2023 1 · Xiaocheng Lu, Ziming Liu, Song Guo, Jingcai Guo

Compositional Zero-Shot Learning (CZSL) aims to recognize novel concepts formed by known states and objects during training. Existing methods either learn the combined state-object representation, challenging the general…

Compositional Zero-Shot LearningNovel ConceptsObjectZero-Shot Learning