paper-with-me

홈 › Papers

AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation

2024-05-19 · Suorong Yang, Peijia Li, Xin Xiong, Furao Shen, Jian Zhao

Data augmentation (DA) is widely employed to improve the generalization performance of deep models. However, most existing DA methods use augmentation operations with random magnitudes throughout training. While this fosters diversity, it can also inevitably introduce uncontrolled variability in augmented data, which may cause misalignment with the evolving training status of the target models. Both theoretical and empirical findings suggest that this misalignment increases the risks of underfitting and overfitting. To address these limitations, we propose AdaAugment, an innovative and tuning-free Adaptive Augmentation method that utilizes reinforcement learning to dynamically adjust augmentation magnitudes for individual training samples based on real-time feedback from the target network. Specifically, AdaAugment features a dual-model architecture consisting of a policy network and a target network, which are jointly optimized to effectively adapt augmentation magnitudes. The policy network optimizes the variability within the augmented data, while the target network utilizes the adaptively augmented samples for training. Extensive experiments across benchmark datasets and deep architectures demonstrate that AdaAugment consistently outperforms other state-of-the-art DA methods in effectiveness while maintaining remarkable efficiency.

📄 PDF Abstract BibTeX arXiv:2405.11467

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDiversity

Similar Papers 제목 키워드 기반

From Training-Free to Adaptive: Empirical Insights into MLLMs' Understanding of Detection Information

2024-01-31 · Qirui Jiao, Daoyuan Chen, Yilun Huang, Yaliang Li 외

Despite the impressive capabilities of Multimodal Large Language Models (MLLMs) in integrating text and image modalities, challenges remain in accurately interpreting detailed visual elements. Vision detection models exc…

Hallucinationobject-detectionObject DetectionOptical Character Recognition+2

Debate as Optimization: Adaptive Conformal Prediction and Diverse Retrieval for Event Extraction

2024-06-18 · Sijia Wang, Lifu Huang

We propose a multi-agent debate as optimization (DAO) system for event extraction, where the primary objective is to iteratively refine the large language models (LLMs) outputs through debating without parameter tuning. …

Conformal PredictionEvent DetectionEvent ExtractionRAG+1

IP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation

2026-05-28 · Hao Wu, Xiangyang Luo, Hao Wang, Jiawei Zhang 외 arxiv

With the rapid advancement of diffusion models, talking face generation has made remarkable progress. However, existing diffusion-based methods still require task-specific fine-tuning and large-scale audiovisual datasets…

Talking Face Generation

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models

2024-03-20 · Zeyu Liu, Souvik Kundu, Anni Li, Junrui Wan 외

We present a novel Parameter-Efficient Fine-Tuning (PEFT) method, dubbed as Adaptive Freezing of Low Rank Adaptation (AFLoRA). Specifically, for each pre-trained frozen weight tensor, we add a parallel path of trainable …

parameter-efficient fine-tuning

UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model

2023-10-08 · Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye 외

Text is ubiquitous in our visual world, conveying crucial information, such as in documents, websites, and everyday photographs. In this work, we propose UReader, a first exploration of universal OCR-free visually-situat…

DecoderLanguage ModelingLanguage ModellingLarge Language Model+2