paper-with-me

홈 › Papers

Hierarchical Event Grounding

2023-02-08 · Jiefu Ou, Adithya Pratapa, Rishubh Gupta, Teruko Mitamura

Event grounding aims at linking mention references in text corpora to events from a knowledge base (KB). Previous work on this task focused primarily on linking to a single KB event, thereby overlooking the hierarchical aspects of events. Events in documents are typically described at various levels of spatio-temporal granularity (Glavas et al. 2014). These hierarchical relations are utilized in downstream tasks of narrative understanding and schema construction. In this work, we present an extension to the event grounding task that requires tackling hierarchical event structures from the KB. Our proposed task involves linking a mention reference to a set of event labels from a subevent hierarchy in the KB. We propose a retrieval methodology that leverages event hierarchy through an auxiliary hierarchical loss (Murty et al. 2018). On an automatically created multilingual dataset from Wikipedia and Wikidata, our experiments demonstrate the effectiveness of the hierarchical loss against retrieve and re-rank baselines (Wu et al. 2020; Pratapa, Gupta, and Mitamura 2022). Furthermore, we demonstrate the systems' ability to aid hierarchical discovery among unseen events.

📄 PDF Abstract BibTeX arXiv:2302.04197

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Hierarchical Event Memory for Accurate and Low-latency Online Video Temporal Grounding

2025-08-06 · Minghang Zheng, Yuxin Peng, Benyuan Sun, Yi Yang 외 arxiv

In this paper, we tackle the task of online video temporal grounding (OnVTG), which requires the model to locate events related to a given text query within a video stream. Unlike regular video temporal grounding, OnVTG …

HiVG: Hierarchical Multimodal Fine-grained Modulation for Visual Grounding

2024-04-20 · Linhui Xiao, Xiaoshan Yang, Fang Peng, YaoWei Wang 외

Visual grounding, which aims to ground a visual region via natural language, is a task that heavily relies on cross-modal alignment. Existing works utilized uni-modal pre-trained models to transfer visual or linguistic k…

cross-modal alignmentVisual Grounding

Beyond Grounding: Extracting Fine-Grained Event Hierarchies Across Modalities

2022-06-14 · Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh 외

Events describe happenings in our world that are of importance. Naturally, understanding events mentioned in multimedia content and how they are related forms an important way of comprehending our world. Existing literat…

Hierarchical Semantic Correspondence Networks for Video Paragraph Grounding

2023-01-01 · CVPR 2023 1 · Chaolei Tan, Zihang Lin, Jian-Fang Hu, Wei-Shi Zheng 외

Video Paragraph Grounding (VPG) is an essential yet challenging task in vision-language understanding, which aims to jointly localize multiple events from an untrimmed video with a paragraph query description. One of…

DecoderSentenceVideo Grounding

ReVisionLLM: Recursive Vision-Language Model for Temporal Grounding in Hour-Long Videos

2024-11-22 · CVPR 2025 1 · Tanveer Hannan, Md Mohaiminul Islam, Jindong Gu, Thomas Seidl 외

Large language models (LLMs) excel at retrieving information from lengthy text, but their vision-language counterparts (VLMs) face difficulties with hour-long videos, especially for temporal grounding. Specifically, thes…

Language-Based Temporal LocalizationLanguage ModelingLanguage ModellingNatural Language Moment Retrieval