paper-with-me

Papers

TransformMix: Learning Transformation and Mixing Strategies from Data

2024-03-19 · Tsz-Him Cheung, Dit-yan Yeung

Data augmentation improves the generalization power of deep learning models by synthesizing more training samples. Sample-mixing is a popular data augmentation approach that creates additional data by combining existing samples. Recent sample-mixing methods, like Mixup and Cutmix, adopt simple mixing operations to blend multiple inputs. Although such a heuristic approach shows certain performance gains in some computer vision tasks, it mixes the images blindly and does not adapt to different datasets automatically. A mixing strategy that is effective for a particular dataset does not often generalize well to other datasets. If not properly configured, the methods may create misleading mixed images, which jeopardize the effectiveness of sample-mixing augmentations. In this work, we propose an automated approach, TransformMix, to learn better transformation and mixing augmentation strategies from data. In particular, TransformMix applies learned transformations and mixing masks to create compelling mixed images that contain correct and important information for the target tasks. We demonstrate the effectiveness of TransformMix on multiple datasets in transfer learning, classification, object detection, and knowledge distillation settings. Experimental results show that our method achieves better performance as well as efficiency when compared with strong sample-mixing baselines.

📄 PDF Abstract BibTeX arXiv:2403.12429

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationKnowledge Distillationobject-detectionObject DetectionTransfer Learning

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

A Blind Multiscale Spatial Regularization Framework for Kernel-based Spectral Unmixing

2019-08-19 · Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Introducing spatial prior information in hyperspectral imaging (HSI) analysis has led to an overall improvement of the performance of many HSI methods applied for denoising, classification, and unmixing. Extending such m…

DenoisingSuperpixels

Boost Adversarial Transferability by Uniform Scale and Mix Mask Method

2023-11-18 · Tao Wang, Zijian Ying, Qianmu Li, Zhichao Lian

Adversarial examples generated from surrogate models often possess the ability to deceive other black-box models, a property known as transferability. Recent research has focused on enhancing adversarial transferability,…

Mixing Paint: An analysis of color value transformations in multiple coordinate spaces using multivariate linear regression

2024-04-01 · Alexander Messick

I explore the mathematical transformation that occurs in color coordinate space when physically mixing paints of two different colors. I tested 120 pairs of 16 paint colors and used a linear regression to find the most a…

Low-Rank Tensor Modeling for Hyperspectral Unmixing Accounting for Spectral Variability

2018-11-02 · Tales Imbiriba, Ricardo Augusto Borsoi, José Carlos Moreira Bermudez

Traditional hyperspectral unmixing methods neglect the underlying variability of spectral signatures often observed in typical hyperspectral images (HI), propagating these missmodeling errors throughout the whole unmixin…

Hyperspectral Unmixing

Nonlinear ICA Using Volume-Preserving Transformations

2021-09-29 · ICLR 2022 4 · Xiaojiang Yang, Yi Wang, Jiacheng Sun, Xing Zhang 외

Nonlinear ICA is a fundamental problem in machine learning, aiming to identify the underlying independent components (sources) from data which is assumed to be a nonlinear function (mixing function) of these sources. Rec…