Temporal Alignment Prediction for Few-Shot Video Classification
The goal of few-shot video classification is to learn a classification model with good generalization ability when trained with only a few labeled videos. However, it is difficult to learn discriminative feature representations for videos in such a setting. In this paper, we propose Temporal Alignment Prediction (TAP) based on sequence similarity learning for few-shot video classification. In order to obtain the similarity of a pair of videos, we predict the alignment scores between all pairs of temporal positions in the two videos with the temporal alignment prediction function. Besides, the inputs to this function are also equipped with the context information in the temporal domain. We evaluate TAP on two video classification benchmarks including Kinetics and Something-Something V2. The experimental results verify the effectiveness of TAP and show its superiority over state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationPredictionVideo ClassificationSimilar Papers 제목 키워드 기반
Inductive and Transductive Few-Shot Video Classification via Appearance and Temporal Alignments
We present a novel method for few-shot video classification, which performs appearance and temporal alignments. In particular, given a pair of query and support videos, we conduct appearance alignment via frame-level fea…
General ClassificationVideo ClassificationFew-Shot Video Classification via Temporal Alignment
There is a growing interest in learning a model which could recognize novel classes with only a few labeled examples. In this paper, we propose Temporal Alignment Module (TAM), a novel few-shot learning framework that ca…
Action RecognitionClassificationFew Shot Action RecognitionFew-Shot Learning+2Learning Implicit Temporal Alignment for Few-shot Video Classification
Few-shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real-world applications. However, it is particularly challenging to learn …
Action Recognition In VideosClassificationFew-Shot LearningVideo ClassificationActAlign: Zero-Shot Fine-Grained Video Classification via Language-Guided Sequence Alignment
We address the task of zero-shot fine-grained video classification, where no video examples or temporal annotations are available for unseen action classes. While contrastive vision-language models such as SigLIP demonst…
Dynamic Time WarpingLarge Language ModelOpen Set Learningtext similarity+2A Closer Look at Few-Shot Video Classification: A New Baseline and Benchmark
The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these metho…
ClassificationMeta-LearningRepresentation LearningVideo Classification