paper-with-me

홈 › Papers

Multi-task Learning with Extended Temporal Shift Module for Temporal Action Localization

2025-12-12 · Anh-Kiet Duong, Petra Gomez-Krämer arxiv

We present our solution to the BinEgo-360 Challenge at ICCV 2025, which focuses on temporal action localization (TAL) in multi-perspective and multi-modal video settings. The challenge provides a dataset containing panoramic, third-person, and egocentric recordings, annotated with fine-grained action classes. Our approach is built on the Temporal Shift Module (TSM), which we extend to handle TAL by introducing a background class and classifying fixed-length non-overlapping intervals. We employ a multi-task learning framework that jointly optimizes for scene classification and TAL, leveraging contextual cues between actions and environments. Finally, we integrate multiple models through a weighted ensemble strategy, which improves robustness and consistency of predictions. Our method is ranked first in both the initial and extended rounds of the competition, demonstrating the effectiveness of combining multi-task learning, an efficient backbone, and ensemble learning for TAL.

📄 PDF Abstract BibTeX arXiv:2512.11189

Code (0)

등록된 구현이 없습니다.

Tasks

Temporal Action LocalizationScene ClassificationMulti-Task LearningEnsemble Learning

Similar Papers 제목 키워드 기반

TSM: Temporal Shift Module for Efficient Video Understanding

2018-11-20 · ICCV 2019 10 · Ji Lin, Chuang Gan, Song Han

The explosive growth in video streaming gives rise to challenges on performing video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computationally cheap but cannot capture temporal rel…

3D Action RecognitionAction ClassificationAction RecognitionMicro-Action Recognition+6

Multi-Focus Temporal Shifting for Precise Event Spotting in Sports Videos

2025-07-10 · Hao Xu, Xinyu Wei, Sam Wells, Sunil Aryal arxiv

Precise Event Spotting (PES) in sports videos requires frame-level recognition of fine-grained actions from single-camera footage. Existing PES models typically incorporate lightweight temporal modules such as the Gate S…

VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

2024-01-17 · CVPR 2024 1 · Haoxin Chen, Yong Zhang, Xiaodong Cun, Menghan Xia 외

Text-to-video generation aims to produce a video based on a given prompt. Recently, several commercial video models have been able to generate plausible videos with minimal noise, excellent details, and high aesthetic sc…

Text-to-Video GenerationVideo Generation

Effective Action Recognition with Embedded Key Point Shifts

2020-08-26 · Haozhi Cao, Yuecong Xu, Jianfei Yang, Kezhi Mao 외

Temporal feature extraction is an essential technique in video-based action recognition. Key points have been utilized in skeleton-based action recognition methods but they require costly key point annotation. In this pa…

Action RecognitionSkeleton Based Action Recognition

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Device

2021-09-27 · Ji Lin, Chuang Gan, Kuan Wang, Song Han

The explosive growth in video streaming requires video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computationally cheap but cannot capture temporal relationships; 3D CNN-based metho…

Video RecognitionVideo Understanding