LSTC: Boosting Atomic Action Detection with Long-Short-Term Context
In this paper, we place the atomic action detection problem into a Long-Short Term Context (LSTC) to analyze how the temporal reliance among video signals affect the action detection results. To do this, we decompose the action recognition pipeline into short-term and long-term reliance, in terms of the hypothesis that the two kinds of context are conditionally independent given the objective action instance. Within our design, a local aggregation branch is utilized to gather dense and informative short-term cues, while a high order long-term inference branch is designed to reason the objective action class from high-order interaction between actor and other person or person pairs. Both branches independently predict the context-specific actions and the results are merged in the end. We demonstrate that both temporal grains are beneficial to atomic action recognition. On the mainstream benchmarks of atomic action detection, our design can bring significant performance gain from the existing state-of-the-art pipeline. The code of this project can be found at this url
Code (1)
Tasks
Action DetectionAction RecognitionAtomic action recognitionSimilar Papers 제목 키워드 기반
LSTC-MDA: A Unified Framework for Long-Short Term Temporal Convolution and Mixed Data Augmentation in Skeleton-Based Action Recognition
Skeleton-based action recognition faces two longstanding challenges: the scarcity of labeled training samples and difficulty modeling short- and long-range temporal dependencies. To address these issues, we propose a uni…
Action RecognitionData AugmentationOnline learning of windmill time series using Long Short-term Cognitive Networks
Forecasting windmill time series is often the basis of other processes such as anomaly detection, health monitoring, or maintenance scheduling. The amount of data generated on windmill farms makes online learning the mos…
Anomaly DetectionSchedulingTime SeriesTime Series AnalysisLocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents
Modern GUI-agent frameworks achieve strong desktop task performance with frontier API models, yet persistent control information often remains implicit in growing interaction trajectories. At each step, the planner recon…
Scalable Low-Rank Tensor Learning for Spatiotemporal Traffic Data Imputation
Missing value problem in spatiotemporal traffic data has long been a challenging topic, in particular for large-scale and high-dimensional data with complex missing mechanisms and diverse degrees of missingness. Recent s…
ImputationTraffic Data ImputationHierarchical Long Short-Term Concurrent Memory for Human Interaction Recognition
In this paper, we aim to address the problem of human interaction recognition in videos by exploring the long-term inter-related dynamics among multiple persons. Recently, Long Short-Term Memory (LSTM) has become a popul…
Action RecognitionHuman Interaction RecognitionTemporal Action Localization