paper-with-me

홈 › Papers

TemporalMaxer: Maximize Temporal Context with only Max Pooling for Temporal Action Localization

2023-03-16 · Tuan N. Tang, Kwonyoung Kim, Kwanghoon Sohn

Temporal Action Localization (TAL) is a challenging task in video understanding that aims to identify and localize actions within a video sequence. Recent studies have emphasized the importance of applying long-term temporal context modeling (TCM) blocks to the extracted video clip features such as employing complex self-attention mechanisms. In this paper, we present the simplest method ever to address this task and argue that the extracted video clip features are already informative to achieve outstanding performance without sophisticated architectures. To this end, we introduce TemporalMaxer, which minimizes long-term temporal context modeling while maximizing information from the extracted video clip features with a basic, parameter-free, and local region operating max-pooling block. Picking out only the most critical information for adjacent and local clip embeddings, this block results in a more efficient TAL model. We demonstrate that TemporalMaxer outperforms other state-of-the-art methods that utilize long-term TCM such as self-attention on various TAL datasets while requiring significantly fewer parameters and computational resources. The code for our approach is publicly available at https://github.com/TuanTNG/TemporalMaxer

📄 PDF Abstract BibTeX arXiv:2303.09055

Code (1)

tuantng/temporalmaxer 공식 구현 pytorch

Tasks

Action LocalizationTemporal Action LocalizationVideo Understanding

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Benchmarking Data Efficiency and Computational Efficiency of Temporal Action Localization Models

2023-08-24 · Jan Warchocki, Teodor Oprescu, Yunhan Wang, Alexandru Damacus 외

In temporal action localization, given an input video, the goal is to predict which actions it contains, where they begin, and where they end. Training and testing current state-of-the-art deep learning models requires a…

Action LocalizationBenchmarkingComputational EfficiencyTemporal Action Localization

An Effective Transformer-based Contextual Model and Temporal Gate Pooling for Speaker Identification

2023-08-22 · Harunori Kawano, Sota Shimizu

Wav2vec2 has achieved success in applying Transformer architecture and self-supervised learning to speech recognition. Recently, these have come to be used not only for speech recognition but also for the entire speech p…

Self-Supervised LearningSpeaker Identificationspeech-recognitionSpeech Recognition

Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts

2021-04-14 · Silvio Giancola, Bernard Ghanem

Toward the goal of automatic production for sports broadcasts, a paramount task consists in understanding the high-level semantic information of the game in play. For instance, recognizing and localizing the main actions…

Action Spotting

Joint Temporal Pooling for Improving Skeleton-based Action Recognition

2024-08-18 · Shanaka Ramesh Gunasekara, Wanqing Li, Jack Yang, Philip Ogunbona

In skeleton-based human action recognition, temporal pooling is a critical step for capturing spatiotemporal relationship of joint dynamics. Conventional pooling methods overlook the preservation of motion information an…

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Optimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining

2018-11-11 · Ishan Jindal, Zhiwei Qin, Xue-wen Chen, Matthew Nokleby 외

In this paper, we develop a reinforcement learning (RL) based system to learn an effective policy for carpooling that maximizes transportation efficiency so that fewer cars are required to fulfill the given amount of tri…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Travel Time Estimation