paper-with-me

홈 › Papers

Driving Video Retrieval for Complex Queries with Structured Grounding

2026-06-08 · Manyi Yao, Sparsh Garg, Christian Shelton, Amit Roy-Chowdhury, Abhishek Aich arxiv

Video retrieval at scale is central to data curation and safety validation in autonomous driving, where users want to find not only scenes but also dynamic events such as cut-ins and hard braking. Existing vision-language and keyword-based retrieval methods often miss these events because the relevant motion may not be explicitly described in text or captured by lexical overlap. Rule-based retrieval can encode such events more directly, but it is brittle: generated or hand-written rules often fail when their assumptions do not match real driving data. We propose STRIVE-D, a data-calibrated retrieval framework for driving videos. It uses weakly labeled in-domain videos to estimate when a query rule is reliable, adapt rules that mismatch observed data, and fuse calibrated rule scores with vision-language and keyword-based retrieval signals. Across three driving benchmarks, including newly released human-annotated event data on DrivingDojo, STRIVE-D delivers up to 84% relative improvement in top-1 accuracy over state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2606.09109

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingVideo Retrieval

Similar Papers 제목 키워드 기반

Visual Semantic Search: Retrieving Videos via Complex Textual Queries

2014-06-01 · CVPR 2014 6 · Dahua Lin, Sanja Fidler, Chen Kong, Raquel Urtasun

In this paper, we tackle the problem of retrieving videos using complex natural language queries. Towards this goal, we first parse the sentential descriptions into a semantic graph, which is then matched to visual conce…

Autonomous DrivingNatural Language QueriesRetrievalVideo Retrieval

Dialogue-to-Video Retrieval

2023-03-23 · Chenyang Lyu, Manh-Duy Nguyen, Van-Tu Ninh, Liting Zhou 외

Recent years have witnessed an increasing amount of dialogue/conversation on the web especially on social media. That inspires the development of dialogue-based retrieval, in which retrieving videos based on dialogue is …

Recommendation SystemsRetrievalVideo Retrieval

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

2020-07-06 · Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang 외

The rapid growth of user-generated videos on the Internet has intensified the need for text-based video retrieval systems. Traditional methods mainly favor the concept-based paradigm on retrieval with simple queries, whi…

RetrievalVideo Retrieval

Induce, Edit, Retrieve:Language Grounded Multimodal Schema for Instructional Video Retrieval

2021-11-17 · Yue Yang, Joongwon Kim, Artemis Panagopoulou, Mark Yatskar 외

Schemata are structured representations of complex tasks that can aid artificial intelligence by allowing models to break down complex tasks into intermediate steps. We propose a novel system that induces schemata from w…

RetrievalVideo Retrieval

STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases

2024-04-19 · Shirley Wu, Shiyu Zhao, Michihiro Yasunaga, Kexin Huang 외

Answering real-world complex queries, such as complex product search, often requires accurate retrieval from semi-structured knowledge bases that involve blend of unstructured (e.g., textual descriptions of products) and…

BenchmarkingRetrieval