Active Learning with Effective Scoring Functions for Semi-Supervised Temporal Action Localization
Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and proven to be effective. One of the practical bottlenecks in these solutions is the large amount of labeled training data required. To reduce expensive human label cost, this paper focuses on a rarely investigated yet practical task named semi-supervised TAL and proposes an effective active learning method, named AL-STAL. We leverage four steps for actively selecting video samples with high informativeness and training the localization model, named \emph{Train, Query, Annotate, Append}. Two scoring functions that consider the uncertainty of localization model are equipped in AL-STAL, thus facilitating the video sample rank and selection. One takes entropy of predicted label distribution as measure of uncertainty, named Temporal Proposal Entropy (TPE). And the other introduces a new metric based on mutual information between adjacent action proposals and evaluates the informativeness of video samples, named Temporal Context Inconsistency (TCI). To validate the effectiveness of proposed method, we conduct extensive experiments on two benchmark datasets THUMOS'14 and ActivityNet 1.3. Experiment results show that AL-STAL outperforms the existing competitors and achieves satisfying performance compared with fully-supervised learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Action LocalizationActive LearningInformativenessTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Semi-supervised Active Learning for Instance Segmentation via Scoring Predictions
Active learning generally involves querying the most representative samples for human labeling, which has been widely studied in many fields such as image classification and object detection. However, its potential has n…
Active Learningimage-classificationImage ClassificationInstance Segmentation+5BASIL: Balanced Active Semi-supervised Learning for Class Imbalanced Datasets
Current semi-supervised learning (SSL) methods assume a balance between the number of data points available for each class in both the labeled and the unlabeled data sets. However, there naturally exists a class imbalanc…
Active LearningSemi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection
Semi-supervised dialogue summarization (SSDS) leverages model-generated summaries to reduce reliance on human-labeled data and improve the performance of summarization models. While addressing label noise, previous works…
Abstractive Text SummarizationNatural Language UnderstandingUnderstanding Bias in Anomaly Detection: A Semi-Supervised View with PAC Guarantees
Anomaly detection presents a unique challenge in machine learning, due to the scarcity of labeled anomaly data. Existing work attempts to mitigate such problems via semi-supervised learning, i.e., augmenting unsupervised…
Anomaly DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Anomaly DetectionAn Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series
Several techniques for multivariate time series anomaly detection have been proposed recently, but a systematic comparison on a common set of datasets and metrics is lacking. This paper presents a systematic and comprehe…
Anomaly DetectionTime SeriesTime Series AnalysisTime Series Anomaly Detection