SearchAD: Large-Scale Rare Image Retrieval Dataset for Autonomous Driving

2026-04-09 · Felix Embacher, Jonas Uhrig, Marius Cordts, Markus Enzweiler arxiv

Retrieving rare and safety-critical driving scenarios from large-scale datasets is essential for building robust autonomous driving (AD) systems. As dataset sizes continue to grow, the key challenge shifts from collecting more data to efficiently identifying the most relevant samples. We introduce SearchAD, a large-scale rare image retrieval dataset for AD containing over 423k frames drawn from 11 established datasets. SearchAD provides high-quality manual annotations of more than 513k bounding boxes covering 90 rare categories. It specifically targets the needle-in-a-haystack problem of locating extremely rare classes, with some appearing fewer than 50 times across the entire dataset. Unlike existing benchmarks, which focused on instance-level retrieval, SearchAD emphasizes semantic image retrieval with a well-defined data split, enabling text-to-image and image-to-image retrieval, few-shot learning, and fine-tuning of multi-modal retrieval models. Comprehensive evaluations show that text-based methods outperform image-based ones due to stronger inherent semantic grounding. While models directly aligning spatial visual features with language achieve the best zero-shot results, and our fine-tuning baseline significantly improves performance, absolute retrieval capabilities remain unsatisfactory. With a held-out test set on a public benchmark server, SearchAD establishes the first large-scale dataset for retrieval-driven data curation and long-tail perception research in AD: https://iis-esslingen.github.io/searchad/

📄 PDF Abstract BibTeX arXiv:2604.08008

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Few-Shot Learning Image Retrieval

Learning Efficient Representations for Image-Based Patent Retrieval

2023-08-26 · Hongsong Wang, Yuqi Zhang

Patent retrieval has been attracting tremendous interest from researchers in intellectual property and information retrieval communities in the past decades. However, most existing approaches rely on textual and metadata…

Image Retrieval Information Retrieval Retrieval

FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models

2026-06-15 · Jiaju Han, Ben Zhang, Xuemeng Sun, Qike Zhang 외 arxiv

Remote sensing vision-language models have advanced Earth observation understanding, but most existing work remains centered on RGB imagery, leaving the complementary information in infrared data underexplored. Infrared …

Representation Learning Text Retrieval

RARE: Retrieval-Aware Robustness Evaluation for Retrieval-Augmented Generation Systems

2025-06-01 · Yixiao Zeng, Tianyu Cao, Danqing Wang, Xinran Zhao 외

Retrieval-Augmented Generation (RAG) enhances recency and factuality in answers. However, existing evaluations rarely test how well these systems cope with real-world noise, conflicting between internal and external retr…

RAG Retrieval Retrieval-augmented Generation

Re-Imagen: Retrieval-Augmented Text-to-Image Generator

2022-09-29 · Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen

Research on text-to-image generation has witnessed significant progress in generating diverse and photo-realistic images, driven by diffusion and auto-regressive models trained on large-scale image-text data. Though stat…

Image Generation Image-text Retrieval Retrieval Text Retrieval+2

SCA-PVNet: Self-and-Cross Attention Based Aggregation of Point Cloud and Multi-View for 3D Object Retrieval

2023-07-20 · Dongyun Lin, Yi Cheng, Aiyuan Guo, Shangbo Mao 외

To address 3D object retrieval, substantial efforts have been made to generate highly discriminative descriptors of 3D objects represented by a single modality, e.g., voxels, point clouds or multi-view images. It is prom…

3D Object Retrieval Object Retrieval