paper-with-me

Papers

Continual Learning Based on OOD Detection and Task Masking

2022-03-17 · Gyuhak Kim, Sepideh Esmaeilpour, Changnan Xiao, Bing Liu

Existing continual learning techniques focus on either task incremental learning (TIL) or class incremental learning (CIL) problem, but not both. CIL and TIL differ mainly in that the task-id is provided for each test sample during testing for TIL, but not provided for CIL. Continual learning methods intended for one problem have limitations on the other problem. This paper proposes a novel unified approach based on out-of-distribution (OOD) detection and task masking, called CLOM, to solve both problems. The key novelty is that each task is trained as an OOD detection model rather than a traditional supervised learning model, and a task mask is trained to protect each task to prevent forgetting. Our evaluation shows that CLOM outperforms existing state-of-the-art baselines by large margins. The average TIL/CIL accuracy of CLOM over six experiments is 87.6/67.9% while that of the best baselines is only 82.4/55.0%.

📄 PDF Abstract BibTeX arXiv:2203.09450

Code (1)

k-gyuhak/clom 공식 구현 pytorch

Tasks

class-incremental learningClass Incremental LearningContinual LearningIncremental LearningOut of Distribution (OOD) Detection

Similar Papers 제목 키워드 기반

Linguistic Entity Masking to Improve Cross-Lingual Representation of Multilingual Language Models for Low-Resource Languages

2025-01-10 · Aloka Fernando, Surangika Ranathunga

Multilingual Pre-trained Language models (multiPLMs), trained on the Masked Language Modelling (MLM) objective are commonly being used for cross-lingual tasks such as bitext mining. However, the performance of these mode…

Language ModellingSentiment Analysis

Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning

2019-04-05 · CVPR 2019 6 · Oleksiy Ostapenko, Mihai Puscas, Tassilo Klein, Patrick Jähnichen 외

Models trained in the context of continual learning (CL) should be able to learn from a stream of data over an undefined period of time. The main challenges herein are: 1) maintaining old knowledge while simultaneously b…

Continual Learning

Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking

2021-07-17 · ACL 2021 5 · Binzong Geng, Fajie Yuan, Qiancheng Xu, Ying Shen 외

This ability to learn consecutive tasks without forgetting how to perform previously trained problems is essential for developing an online dialogue system. This paper proposes an effective continual learning for the tas…

Continual LearningNetwork Pruning

Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks

2023-10-13 · Zixuan Ke, Bing Liu, Wenhan Xiong, Asli Celikyilmaz 외

Continual learning (CL) has two main objectives: preventing catastrophic forgetting (CF) and encouraging knowledge transfer (KT). The existing literature mainly focused on overcoming CF. Some work has also been done on K…

Continual LearningTransfer Learning

Family Matters: A Systematic Study of Spatial vs. Frequency Masking for Continual Test-Time Adaptation

2025-12-08 · Chandler Timm C. Doloriel, Yunbei Zhang, Yeonguk Yu, Taki Hasan Rafi 외 arxiv

Recent continual test-time adaptation (CTTA) methods adopt masked image modeling to stabilize learning under distribution shift, yet each treats its masking family F as a fixed design choice and innovates exclusively alo…

Test-time Adaptation