paper-with-me

Papers

Continual Learning Improves Zero-Shot Action Recognition

2024-10-14 · Shreyank N Gowda, Davide Moltisanti, Laura Sevilla-Lara

Zero-shot action recognition requires a strong ability to generalize from pre-training and seen classes to novel unseen classes. Similarly, continual learning aims to develop models that can generalize effectively and learn new tasks without forgetting the ones previously learned. The generalization goals of zero-shot and continual learning are closely aligned, however techniques from continual learning have not been applied to zero-shot action recognition. In this paper, we propose a novel method based on continual learning to address zero-shot action recognition. This model, which we call {\em Generative Iterative Learning} (GIL) uses a memory of synthesized features of past classes, and combines these synthetic features with real ones from novel classes. The memory is used to train a classification model, ensuring a balanced exposure to both old and new classes. Experiments demonstrate that {\em GIL} improves generalization in unseen classes, achieving a new state-of-the-art in zero-shot recognition across multiple benchmarks. Importantly, {\em GIL} also boosts performance in the more challenging generalized zero-shot setting, where models need to retain knowledge about classes seen before fine-tuning.

📄 PDF Abstract BibTeX arXiv:2410.10497

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionContinual LearningZero-Shot Action RecognitionZero-Shot Learning

Similar Papers 제목 키워드 기반

Open-VCLIP: Transforming CLIP to an Open-vocabulary Video Model via Interpolated Weight Optimization

2023-02-01 · Zejia Weng, Xitong Yang, Ang Li, Zuxuan Wu 외

Contrastive Language-Image Pretraining (CLIP) has demonstrated impressive zero-shot learning abilities for image understanding, yet limited effort has been made to investigate CLIP for zero-shot video recognition. We int…

Action RecognitionContinual LearningVideo RecognitionZero-Shot Learning

Novel Semantic Prompting for Zero-Shot Action Recognition

2026-03-09 · Salman Iqbal, Waheed Rehman arxiv

Zero-shot action recognition relies on transferring knowledge from vision-language models to unseen actions using semantic descriptions. While recent methods focus on temporal modeling or architectural adaptations to han…

Zero-Shot Action RecognitionAction Understanding

Can masking background and object reduce static bias for zero-shot action recognition?

2025-01-22 · Takumi Fukuzawa, Kensho Hara, Hirokatsu Kataoka, Toru Tamaki

In this paper, we address the issue of static bias in zero-shot action recognition. Action recognition models need to represent the action itself, not the appearance. However, some fully-supervised works show that models…

Action RecognitionZero-Shot Action Recognition

A New Split for Evaluating True Zero-Shot Action Recognition

2021-07-27 · Shreyank N Gowda, Laura Sevilla-Lara, Kiyoon Kim, Frank Keller 외

Zero-shot action recognition is the task of classifying action categories that are not available in the training set. In this setting, the standard evaluation protocol is to use existing action recognition datasets(e.g. …

Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionZero-Shot Action Recognition+1

CL-CLIP: CLIP-Based Continual Learning Framework with Cost-Volume Category Decoupling for Object Detection

2026-06-05 · Zihan Liu, Yuguang Yang, Shengjie Su, Jianing Pang 외 arxiv

Continual Object Detection (COD) requires a detector to acquire new categories over time while preserving previously learned ones. This goal is closely related to open-vocabulary detection, since both settings require re…

Zero-shot GeneralizationContinual LearningObject Detection