paper-with-me

홈 › Papers

Temporal Aggregate Representations for Long-Range Video Understanding

2020-06-01 · ECCV 2020 8 · Fadime Sener, Dipika Singhania, Angela Yao

Future prediction, especially in long-range videos, requires reasoning from current and past observations. In this work, we address questions of temporal extent, scaling, and level of semantic abstraction with a flexible multi-granular temporal aggregation framework. We show that it is possible to achieve state of the art in both next action and dense anticipation with simple techniques such as max-pooling and attention. To demonstrate the anticipation capabilities of our model, we conduct experiments on Breakfast, 50Salads, and EPIC-Kitchens datasets, where we achieve state-of-the-art results. With minimal modifications, our model can also be extended for video segmentation and action recognition.

📄 PDF Abstract BibTeX arXiv:2006.00830

Code (2)

dibschat/tempAgg 공식 구현 pytorch
dipika-singhania/multi-scale-action-banks pytorch

Tasks

Action AnticipationAction RecognitionFuture predictionVideo SegmentationVideo Semantic SegmentationVideo Understanding

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Similar Papers 제목 키워드 기반

HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics

2024-08-30 · Gueter Josmy Faure, Jia-Fong Yeh, Min-Hung Chen, Hung-Ting Su 외

Existing research often treats long-form videos as extended short videos, leading to several limitations: inadequate capture of long-range dependencies, inefficient processing of redundant information, and failure to ext…

FormVideo Classificationzero-shot long video breakpoint-mode question answeringzero-shot long video global-model question answering+2

MS-Temba : Multi-Scale Temporal Mamba for Efficient Temporal Action Detection

2025-01-10 · Arkaprava Sinha, Monish Soundar Raj, Pu Wang, Ahmed Helmy 외

Action detection in real-world scenarios is particularly challenging due to densely distributed actions in hour-long untrimmed videos. It requires modeling both short- and long-term temporal relationships while handling …

Action DetectionGPUMamba

TGBFormer: Transformer-GraphFormer Blender Network for Video Object Detection

2025-03-18 · Qiang Qi, Xiao Wang

Video object detection has made significant progress in recent years thanks to convolutional neural networks (CNNs) and vision transformers (ViTs). Typically, CNNs excel at capturing local features but struggle to model …

GPUobject-detectionObject DetectionVideo Object Detection

Video Dehazing via a Multi-Range Temporal Alignment Network with Physical Prior

2023-03-17 · CVPR 2023 1 · Jiaqi Xu, Xiaowei Hu, Lei Zhu, Qi Dou 외

Video dehazing aims to recover haze-free frames with high visibility and contrast. This paper presents a novel framework to effectively explore the physical haze priors and aggregate temporal information. Specifically, w…

LTCA: Long-range Temporal Context Attention for Referring Video Object Segmentation

2025-10-09 · Cilin Yan, Jingyun Wang, Guoliang Kang arxiv

Referring Video Segmentation (RVOS) aims to segment objects in videos given linguistic expressions. The key to solving RVOS is to extract long-range temporal context information from the interactions of expressions and v…

Referring Video Object SegmentationVideo Segmentation