paper-with-me

홈 › Papers

Bidirectional Semantic Complementary Tool Retrieval for Remote Sensing Agents

2026-04-29 · Zeyuan Wang, Dongyang Hou, Cheng Yang, Xuezhi Cui, Linrui Xu, Bo Yu, Gaozhi Zhou, Ziyu Li, Liangtian Liu, Kai Ouyang, Wang Guo, Lili Zhu, Chao Tao arxiv

Large language model (LLM)-based agents provide a novel paradigm for the automated processing of remote sensing(RS) data. Their success in complex RS tasks rely on extensive specialized tool libraries. However, tool documentation often exceeds the context window limits of LLMs, making precise tool retrieval essential for agentic workflows. Existing tool retrieval methods face "semantic asymmetry" bottleneck: natural language queries typically express macro-level intentions lacking tool-specific semantics, while tool documentation provides fine-grained technical descriptions lacking operational context for workflows. To bridge this semantic gap, this paper proposes a bidirectional semantic complementary tool retrieval method. First, on the query side, we introduce a planning-based query enhancement mechanism that leverages the reasoning capabilities of agents to decompose abstract intentions into logical subtasks, thereby actively supplementing the query with missing functional semantics. Second, on the tool side, addressing the strong coupling characteristics of RS tool chains, we construct a dynamic tool dependency graph with continual learning capabilities. By employing a neighborhood information aggregation mechanism, contextual information from precursor tools is explicitly injected into the current node representation, enriching tool descriptions with contextual semantics. Experimental results on the RS dataset GeoPlan-bench and the general-purpose dataset API- Bank demonstrate that the proposed method not only significantly improves tool retrieval accuracy for complex RS tasks but also exhibits robust extensibility for transfer to general-domain tasks. The source code and dataset are available at https://github.com/geox-lab/BSCTR.

📄 PDF Abstract BibTeX arXiv:2606.07538

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language QueriesContinual Learning

Similar Papers 제목 키워드 기반

Scale-Semantic Joint Decoupling Network for Image-text Retrieval in Remote Sensing

2022-12-12 · Chengyu Zheng, Ning Song, Ruoyu Zhang, Lei Huang 외

Image-text retrieval in remote sensing aims to provide flexible information for data analysis and application. In recent years, state-of-the-art methods are dedicated to ``scale decoupling'' and ``semantic decoupling'' s…

Cross-Modal RetrievalImage-text RetrievalRetrievalText Retrieval

Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrieval

2025-11-11 · Likang Peng, Chao Su, Wenyuan Wu, Yuan Sun 외 arxiv

Cross-modal hashing (CMH) facilitates efficient retrieval across different modalities (e.g., image and text) by encoding data into compact binary representations. While recent methods have achieved remarkable performance…

Cross-Modal RetrievalContrastive Learning

Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Network

2019-02-15 · Rui Cao, Qian Zhang, Jiasong Zhu, Qing Li 외

With the rapid growing of remotely sensed imagery data, there is a high demand for effective and efficient image retrieval tools to manage and exploit such data. In this letter, we present a novel content-based remote se…

Image RetrievalMetric LearningRetrievalTriplet

DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval

2026-08-06 · Xi Chen, Xu Chen, Xiangyang Jia, Wei Wang 외 arxiv

With the rapid growth of Earth observation technologies, remote sensing archives are rapidly expanding, making remote sensing image-text retrieval (RS-ITR) increasingly important. However, continual RS-ITR remains challe…

Continual LearningText Retrieval

Benchmarking Composed Image Retrieval for Applied Earth Observation

2026-05-23 · Bill Psomas, Dionysis Christopoulos, Thanasis Petropoulos, Nikos Efthymiadis 외 arxiv

Remote sensing composed image retrieval (RSCIR) enables search in large satellite image archives using composed queries that combine a reference image with a textual modifier. Although RSCIR offers a flexible interface f…

Image Retrieval