paper-with-me

홈 › Papers

Enhancing Weakly Supervised Video Grounding via Diverse Inference Strategies for Boundary and Prediction Selection

2025-03-29 · Sunoh Kim, Daeho Um

Weakly supervised video grounding aims to localize temporal boundaries relevant to a given query without explicit ground-truth temporal boundaries. While existing methods primarily use Gaussian-based proposals, they overlook the importance of (1) boundary prediction and (2) top-1 prediction selection during inference. In their boundary prediction, boundaries are simply set at half a standard deviation away from a Gaussian mean on both sides, which may not accurately capture the optimal boundaries. In the top-1 prediction process, these existing methods rely heavily on intersections with other proposals, without considering the varying quality of each proposal. To address these issues, we explore various inference strategies by introducing (1) novel boundary prediction methods to capture diverse boundaries from multiple Gaussians and (2) new selection methods that take proposal quality into account. Extensive experiments on the ActivityNet Captions and Charades-STA datasets validate the effectiveness of our inference strategies, demonstrating performance improvements without requiring additional training.

📄 PDF Abstract BibTeX arXiv:2503.23181

Code (0)

등록된 구현이 없습니다.

Tasks

PredictionVideo Grounding

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding

2024-09-10 · Ji Ha Jang, Hoigi Seo, Se Young Chun

Affordance denotes the potential interactions inherent in objects. The perception of affordance can enable intelligent agents to navigate and interact with new environments efficiently. Weakly supervised affordance groun…

Contrastive LearningLanguage ModelingLanguage ModellingNavigate+1

Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding

2024-03-18 · CVPR 2024 1 · Chaolei Tan, JianHuang Lai, Wei-Shi Zheng, Jian-Fang Hu

Video Paragraph Grounding (VPG) is an emerging task in video-language understanding, which aims at localizing multiple sentences with semantic relations and temporal order from an untrimmed video. However, existing VPG a…

Multiple Instance Learning

Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding

2023-12-27 · Sunoh Kim, Jungchan Cho, Joonsang Yu, Youngjoon Yoo 외

In the weakly supervised temporal video grounding study, previous methods use predetermined single Gaussian proposals which lack the ability to express diverse events described by the sentence query. To enhance the expre…

SentenceTemporal Sentence GroundingvalidVideo Grounding

Fine-grained Semantic Alignment Network for Weakly Supervised Temporal Language Grounding

2022-10-21 · Findings (EMNLP) 2021 11 · Yuechen Wang, Wengang Zhou, Houqiang Li

Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotations for temporal boundary labels, we are…

cross-modal alignmentSentence

Finding "It": Weakly-Supervised Reference-Aware Visual Grounding in Instructional Videos

2018-06-01 · CVPR 2018 6 · De-An Huang, Shyamal Buch, Lucio Dery, Animesh Garg 외

Grounding textual phrases in visual content with standalone image-sentence pairs is a challenging task. When we consider grounding in instructional videos, this problem becomes profoundly more complex: the latent tempora…

Multiple Instance LearningSentenceVisual Grounding