paper-with-me

Papers

MetaMix: Towards Corruption-Robust Continual Learning With Temporally Self-Adaptive Data Transformation

2023-01-01 · CVPR 2023 1 · Zhenyi Wang, Li Shen, Donglin Zhan, Qiuling Suo, Yanjun Zhu, Tiehang Duan, Mingchen Gao

Continual Learning (CL) has achieved rapid progress in recent years. However, it is still largely unknown how to determine whether a CL model is trustworthy and how to foster its trustworthiness. This work focuses on evaluating and improving the robustness to corruptions of existing CL models. Our empirical evaluation results show that existing state-of-the-art (SOTA) CL models are particularly vulnerable to various data corruptions during testing. To make them trustworthy and robust to corruptions deployed in safety-critical scenarios, we propose a meta-learning framework of self-adaptive data augmentation to tackle the corruption robustness in CL. The proposed framework, MetaMix, learns to augment and mix data, automatically transforming the new task data or memory data. It directly optimizes the generalization performance against data corruptions during training. To evaluate the corruption robustness of our proposed approach, we construct several CL corruption datasets with different levels of severity. We perform comprehensive experiments on both task- and class-continual learning. Extensive experiments demonstrate the effectiveness of our proposed method compared to SOTA baselines.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningData AugmentationMeta-Learning

Similar Papers 제목 키워드 기반

MetaMixer Is All You Need

2024-06-04 · Seokju Yun, Dongheon Lee, Youngmin Ro

Transformer, composed of self-attention and Feed-Forward Network, has revolutionized the landscape of network design across various vision tasks. FFN is a versatile operator seamlessly integrated into nearly all AI model…

All

MetaMixUp: Learning Adaptive Interpolation Policy of MixUp with Meta-Learning

2019-08-27 · Zhijun Mai, Guosheng Hu, Dexiong Chen, Fumin Shen 외

MixUp is an effective data augmentation method to regularize deep neural networks via random linear interpolations between pairs of samples and their labels. It plays an important role in model regularization, semi-super…

Data AugmentationDomain AdaptationMeta-LearningPseudo Label

MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization

2020-09-29 · Yangbin Chen, Yun Ma, Tom Ko, Jian-Ping Wang 외

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized mo…

Few-Shot LearningMeta-LearningTransfer Learning

MetaMixer: A Regularization Strategy for Online Knowledge Distillation

2023-03-14 · Maorong Wang, Ling Xiao, Toshihiko Yamasaki

Online knowledge distillation (KD) has received increasing attention in recent years. However, while most existing online KD methods focus on developing complicated model structures and training strategies to improve the…

Knowledge Distillation

BayesTTA: Continual-Temporal Test-Time Adaptation for Vision-Language Models via Gaussian Discriminant Analysis

2025-07-11 · Shuang Cui, Jinglin Xu, Yi Li, Xiongxin Tang 외 arxiv

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination …

Test-time Adaptation