ToolRerank: Adaptive and Hierarchy-Aware Reranking for Tool Retrieval
Tool learning aims to extend the capabilities of large language models (LLMs) with external tools. A major challenge in tool learning is how to support a large number of tools, including unseen tools. To address this challenge, previous studies have proposed retrieving suitable tools for the LLM based on the user query. However, previously proposed methods do not consider the differences between seen and unseen tools, nor do they take the hierarchy of the tool library into account, which may lead to suboptimal performance for tool retrieval. Therefore, to address the aforementioned issues, we propose ToolRerank, an adaptive and hierarchy-aware reranking method for tool retrieval to further refine the retrieval results. Specifically, our proposed ToolRerank includes Adaptive Truncation, which truncates the retrieval results related to seen and unseen tools at different positions, and Hierarchy-Aware Reranking, which makes retrieval results more concentrated for single-tool queries and more diverse for multi-tool queries. Experimental results show that ToolRerank can improve the quality of the retrieval results, leading to better execution results generated by the LLM.
Code (0)
등록된 구현이 없습니다.
Tasks
RerankingRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AcuRank: Uncertainty-Aware Adaptive Computation for Listwise Reranking
Listwise reranking with large language models (LLMs) enhances top-ranked results in retrieval-based applications. Due to the limit in context size and high inference cost of long context, reranking is typically performed…
RerankingRetrievalDensity-Adaptive Kernel based Efficient Reranking Approaches for Person Reidentification
Person reidentification (ReID) refers to the task of verifying the identity of a pedestrian observed from nonoverlapping views in a surveillance camera network. It has recently been validated that reranking can achieve r…
Person Re-IdentificationRerankingAdaptive Hierarchical Evaluation of LLMs and SAST tools for CWE Prediction in Python
Large Language Models have become integral to software development, yet they frequently generate vulnerable code. Existing code vulnerability detection benchmarks employ binary classification, lacking the CWE-level speci…
Vulnerability DetectionBinary ClassificationHierarchy-Aware Supervised Uncertainty Estimation for Black-box LLM Taxonomic Reasoning
Large language models (LLMs) are increasingly used for scientific decision support, yet reliable confidence estimation remains difficult in black-box settings. We study uncertainty estimation for hierarchical taxonomic r…
Tool-Adaptive LLM Reranker
Generative Large Language Models (LLMs) have revolutionized information retrieval, yet their strictly parametric nature frequently leads to severe factual hallucinations when confronted with complex queries beyond their …
Reinforcement LearningInformation Retrieval