Temporal Action Localization by Structured Maximal Sums
We address the problem of temporal action localization in videos. We pose action localization as a structured prediction over arbitrary-length temporal windows, where each window is scored as the sum of frame-wise classification scores. Additionally, our model classifies the start, middle, and end of each action as separate components, allowing our system to explicitly model each action's temporal evolution and take advantage of informative temporal dependencies present in this structure. In this framework, we localize actions by searching for the structured maximal sum, a problem for which we develop a novel, provably-efficient algorithmic solution. The frame-wise classification scores are computed using features from a deep Convolutional Neural Network (CNN), which are trained end-to-end to directly optimize for a novel structured objective. We evaluate our system on the THUMOS 14 action detection benchmark and achieve competitive performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionAction LocalizationGeneral ClassificationStructured PredictionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Max-Margin Structured Output Regression for Spatio-Temporal Action Localization
Structured output learning has been successfully applied to object localization, where the mapping between an image and an object bounding box can be well captured. Its extension to action localization in videos, however…
Action LocalizationObject LocalizationregressionSpatio-Temporal Action Localization+1Structured Attention Composition for Temporal Action Localization
Temporal action localization aims at localizing action instances from untrimmed videos. Existing works have designed various effective modules to precisely localize action instances based on appearance and motion feature…
Action DetectionAction LocalizationTemporal Action LocalizationNonmaximal sums of maximally monotone operators under Rockafellar's constraint qualification
We construct counterexamples to Rockafellar's sum conjecture in which two maximally monotone operators satisfy the interior-domain condition but their sum is not maximally monotone. We give one counterexample on $c_0$ an…
How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning?
Magnetic Resonance Imaging (MRI) interpretation is fundamental to clinical decision-making, requiring radiologists to integrate multi-view anatomical planes across sequential timepoints while precisely localizing interva…
Spatial ReasoningGUIDEd Agents: Enhancing Navigation Policies through Task-Specific Uncertainty Abstraction in Localization-Limited Environments
Autonomous vehicles performing navigation tasks in complex environments face significant challenges due to uncertainty in state estimation. In many scenarios, such as stealth operations or resource-constrained settings, …
Autonomous VehiclesDecision MakingManagementRobot Navigation+1