paper-with-me

Papers

Anytime Continual Learning for Open Vocabulary Classification

2024-09-13 · Zhen Zhu, Yiming Gong, Derek Hoiem

We propose an approach for anytime continual learning (AnytimeCL) for open vocabulary image classification. The AnytimeCL problem aims to break away from batch training and rigid models by requiring that a system can predict any set of labels at any time and efficiently update and improve when receiving one or more training samples at any time. Despite the challenging goal, we achieve substantial improvements over recent methods. We propose a dynamic weighting between predictions of a partially fine-tuned model and a fixed open vocabulary model that enables continual improvement when training samples are available for a subset of a task's labels. We also propose an attention-weighted PCA compression of training features that reduces storage and computation with little impact to model accuracy. Our methods are validated with experiments that test flexibility of learning and inference. Code is available at https://github.com/jessemelpolio/AnytimeCL.

📄 PDF Abstract BibTeX arXiv:2409.08518

Code (1)

jessemelpolio/anytimecl 공식 구현 pytorch

Tasks

ClassificationContinual Learningimage-classificationImage ClassificationOpen Vocabulary Image Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Continual Learning in Open-vocabulary Classification with Complementary Memory Systems

2023-07-04 · Zhen Zhu, Weijie Lyu, Yao Xiao, Derek Hoiem

We introduce a method for flexible and efficient continual learning in open-vocabulary image classification, drawing inspiration from the complementary learning systems observed in human cognition. Specifically, we propo…

Continual Learningimage-classificationImage ClassificationOpen Vocabulary Image Classification

kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large Vocabularies

2024-04-15 · Zhongrui Gui, Shuyang Sun, Runjia Li, Jianhao Yuan 외

Continual segmentation has not yet tackled the challenge of improving open-vocabulary segmentation models with training data for accurate segmentation across large, continually expanding vocabularies. We discover that tr…

Panoptic SegmentationRetrievalSegmentationZero Shot Segmentation

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging

2026-02-03 · Alexandru Meterez, Pranav Ajit Nair, Depen Morwani, Cengiz Pehlevan 외 arxiv

Large language models are increasingly trained in continual or open-ended settings, where the total training horizon is not known in advance. Despite this, most existing pretraining recipes are not anytime: they rely on …

COVD: Continual Open-Vocabulary Object Detection with Novel Concept Injection

2026-05-26 · Yupeng Zhang, Ruize Han, Yuzhong Feng, Zixin Ren 외 arxiv

Open-vocabulary object detection (OVD) has made significant progress, enabling detectors to generalize from seen to unseen categories. However, real-world category spaces continually evolve, and existing OVD models still…

Continual LearningObject Detection

CL-CLIP: CLIP-Based Continual Learning Framework with Cost-Volume Category Decoupling for Object Detection

2026-06-05 · Zihan Liu, Yuguang Yang, Shengjie Su, Jianing Pang 외 arxiv

Continual Object Detection (COD) requires a detector to acquire new categories over time while preserving previously learned ones. This goal is closely related to open-vocabulary detection, since both settings require re…

Zero-shot GeneralizationContinual LearningObject Detection