Revisiting Few-shot Activity Detection with Class Similarity Control
Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desirable. In this paper, we present a conceptually simple and general yet novel framework for few-shot temporal activity detection based on proposal regression which detects the start and end time of the activities in untrimmed videos. Our model is end-to-end trainable, takes into account the frame rate differences between few-shot activities and untrimmed test videos, and can benefit from additional few-shot examples. We experiment on three large scale benchmarks for temporal activity detection (ActivityNet1.2, ActivityNet1.3 and THUMOS14 datasets) in a few-shot setting. We also study the effect on performance of different amount of overlap with activities used to pretrain the video classification backbone and propose corrective measures for future works in this domain. Our code will be made available.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionVideo ClassificationSimilar Papers 제목 키워드 기반
Similarity R-C3D for Few-shot Temporal Activity Detection
Many activities of interest are rare events, with only a few labeled examples available. Therefore models for temporal activity detection which are able to learn from a few examples are desirable. In this paper, we prese…
Action DetectionActivity DetectionFew-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection
In this paper, we propose a novel few-shot optimization with HED-LM (Hybrid Euclidean Distance with Large Language Models) to improve example selection for sensor-based classification tasks. While few-shot prompting enab…
Activity RecognitionHuman Activity RecognitionS3D: Single Shot multi-Span Detector via Fully 3D Convolutional Networks
In this paper, we present a novel Single Shot multi-Span Detector for temporal activity detection in long, untrimmed videos using a simple end-to-end fully three-dimensional convolutional (Conv3D) network. Our architectu…
Action DetectionActivity DetectionZSTAD: Zero-Shot Temporal Activity Detection
An integral part of video analysis and surveillance is temporal activity detection, which means to simultaneously recognize and localize activities in long untrimmed videos. Currently, the most effective methods of tempo…
Action DetectionActivity DetectionIncremental Few-Shot Object Detection
Most existing object detection methods rely on the availability of abundant labelled training samples per class and offline model training in a batch mode. These requirements substantially limit their scalability to open…
Few-Shot LearningFew-Shot Object DetectionIncremental LearningMeta-Learning+3