paper-with-me

홈 › Papers

An empirical study of the effect of video encoders on Temporal Video Grounding

2025-10-19 · Ignacio M. De la Jara, Cristian Rodriguez-Opazo, Edison Marrese-Taylor, Felipe Bravo-Marquez arxiv

Temporal video grounding is a fundamental task in computer vision, aiming to localize a natural language query in a long, untrimmed video. It has a key role in the scientific community, in part due to the large amount of video generated every day. Although we find extensive work in this task, we note that research remains focused on a small selection of video representations, which may lead to architectural overfitting in the long run. To address this issue, we propose an empirical study to investigate the impact of different video features on a classical architecture. We extract features for three well-known benchmarks, Charades-STA, ActivityNet-Captions and YouCookII, using video encoders based on CNNs, temporal reasoning and transformers. Our results show significant differences in the performance of our model by simply changing the video encoder, while also revealing clear patterns and errors derived from the use of certain features, ultimately indicating potential feature complementarity.

📄 PDF Abstract BibTeX arXiv:2510.17007

Code (0)

등록된 구현이 없습니다.

Tasks

Video Grounding

Similar Papers 제목 키워드 기반

Video Time: Properties, Encoders and Evaluation

2018-07-18 · Amir Ghodrati, Efstratios Gavves, Cees G. M. Snoek

Time-aware encoding of frame sequences in a video is a fundamental problem in video understanding. While many attempted to model time in videos, an explicit study on quantifying video time is missing. To fill this lacuna…

Video Understanding

Dynamic Reflections: Probing Video Representations with Text Alignment

2025-11-04 · Tyler Zhu, Tengda Han, Leonidas Guibas, Viorica Pătrăucean 외 arxiv

The alignment of representations from different modalities has recently been shown to provide insights on the structural similarities and downstream capabilities of different encoders across diverse data types. While sig…

Masked Autoencoders for Egocentric Video Understanding @ Ego4D Challenge 2022

2022-11-18 · Jiachen Lei, Shuang Ma, Zhongjie Ba, Sai Vemprala 외

In this report, we present our approach and empirical results of applying masked autoencoders in two egocentric video understanding tasks, namely, Object State Change Classification and PNR Temporal Localization, of Ego4…

Object State Change ClassificationTemporal LocalizationVideo Understanding

A Paradigm Shift: Fully End-to-End Training for Temporal Sentence Grounding in Videos

2026-04-03 · Allen He, Qi Liu, Kun Liu, Xinchen Liu 외 arxiv

Temporal sentence grounding in videos (TSGV) aims to localize a temporal segment that semantically corresponds to a sentence query from an untrimmed video. Most current methods adopt pre-trained query-agnostic visual enc…

Temporal Sentence Grounding

MTC-VAE: Multi-Level Temporal Compression with Content Awareness

2026-02-01 · Yubo Dong, Linchao Zhu arxiv

Latent Video Diffusion Models (LVDMs) rely on Variational Autoencoders (VAEs) to compress videos into compact latent representations. For continuous Variational Autoencoders (VAEs), achieving higher compression rates is …