TemporalMaxer: Maximize Temporal Context with only Max Pooling for Temporal Action Localization
Temporal Action Localization (TAL) is a challenging task in video understanding that aims to identify and localize actions within a video sequence. Recent studies have emphasized the importance of applying long-term temporal context modeling (TCM) blocks to the extracted video clip features such as employing complex self-attention mechanisms. In this paper, we present the simplest method ever to address this task and argue that the extracted video clip features are already informative to achieve outstanding performance without sophisticated architectures. To this end, we introduce TemporalMaxer, which minimizes long-term temporal context modeling while maximizing information from the extracted video clip features with a basic, parameter-free, and local region operating max-pooling block. Picking out only the most critical information for adjacent and local clip embeddings, this block results in a more efficient TAL model. We demonstrate that TemporalMaxer outperforms other state-of-the-art methods that utilize long-term TCM such as self-attention on various TAL datasets while requiring significantly fewer parameters and computational resources. The code for our approach is publicly available at https://github.com/TuanTNG/TemporalMaxer
Code (1)
Tasks
Action LocalizationTemporal Action LocalizationVideo UnderstandingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Benchmarking Data Efficiency and Computational Efficiency of Temporal Action Localization Models
In temporal action localization, given an input video, the goal is to predict which actions it contains, where they begin, and where they end. Training and testing current state-of-the-art deep learning models requires a…
Action LocalizationBenchmarkingComputational EfficiencyTemporal Action LocalizationAn Effective Transformer-based Contextual Model and Temporal Gate Pooling for Speaker Identification
Wav2vec2 has achieved success in applying Transformer architecture and self-supervised learning to speech recognition. Recently, these have come to be used not only for speech recognition but also for the entire speech p…
Self-Supervised LearningSpeaker Identificationspeech-recognitionSpeech RecognitionTemporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts
Toward the goal of automatic production for sports broadcasts, a paramount task consists in understanding the high-level semantic information of the game in play. For instance, recognizing and localizing the main actions…
Action SpottingJoint Temporal Pooling for Improving Skeleton-based Action Recognition
In skeleton-based human action recognition, temporal pooling is a critical step for capturing spatiotemporal relationship of joint dynamics. Conventional pooling methods overlook the preservation of motion information an…
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationOptimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining
In this paper, we develop a reinforcement learning (RL) based system to learn an effective policy for carpooling that maximizes transportation efficiency so that fewer cars are required to fulfill the given amount of tri…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Travel Time Estimation