Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detection
Open-Vocabulary Aerial Detection (OVAD) and Remote Sensing Visual Grounding (RSVG) have emerged as two key paradigms for aerial scene understanding. However, each paradigm suffers from inherent limitations when operating in isolation: OVAD is restricted to coarse category-level semantics, while RSVG is structurally limited to single-target localization. These limitations prevent existing methods from simultaneously supporting rich semantic understanding and multi-target detection. To address this, we propose OTA-Det, the first unified framework that bridges both paradigms into a cohesive architecture. Specifically, we introduce a task reformulation strategy that unifies task objectives and supervision mechanisms, enabling joint training across datasets from both paradigms with dense supervision signals. Furthermore, we propose a dense semantic alignment strategy that establishes explicit correspondence at multiple granularities, from holistic expressions to individual attributes, enabling fine-grained semantic understanding. To ensure real-time efficiency, OTA-Det builds upon the RT-DETR architecture, extending it from closed-set detection to open-text detection by introducing several high efficient modules, achieving state-of-the-art performance on six benchmarks spanning both OVAD and RSVG tasks while maintaining real-time inference at 34 FPS.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene UnderstandingVisual GroundingText DetectionSimilar Papers 제목 키워드 기반
DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection
With the widespread application of drones in recent years, object detection of aerial images has attracted increasing attention, especially open-vocabulary aerial detection which is not restricted to predefined categorie…
Object DetectionOVA-DETR: Open Vocabulary Aerial Object Detection Using Image-Text Alignment and Fusion
Aerial object detection has been a hot topic for many years due to its wide application requirements. However, most existing approaches can only handle predefined categories, which limits their applicability for the open…
Decoderobject-detectionObject DetectionCross-View Open-Vocabulary Object Detection in Aerial Imagery
Traditional object detection models are typically trained on a fixed set of classes, limiting their flexibility and making it costly to incorporate new categories. Open-vocabulary object detection addresses this limitati…
Text ClassificationObject DetectionHMR-Net: Hierarchical Modular Routing for Cross-Domain Object Detection in Aerial Images
Despite advances in object detection, aerial imagery remains a challenging domain, as models often fail to generalize across variations in spatial resolution, scene composition, and semantic label coverage. Differences i…
Object Detection In Aerial ImagesFrom Word to Sentence: A Large-Scale Multi-Instance Dataset for Open-Set Aerial Detection
In recent years, language-guided open-world aerial object detection has gained significant attention due to its better alignment with real-world application needs. However, due to limited datasets, most existing language…
Sentence