paper-with-me

Papers

Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval

2024-08-03 · Yanfei Chen, Jinsung Yoon, Devendra Singh Sachan, Qingze Wang, Vincent Cohen-Addad, Mohammadhossein Bateni, Chen-Yu Lee, Tomas Pfister

Recent advances in large language models (LLMs) have enabled autonomous agents with complex reasoning and task-fulfillment capabilities using a wide range of tools. However, effectively identifying the most relevant tools for a given task becomes a key bottleneck as the toolset size grows, hindering reliable tool utilization. To address this, we introduce Re-Invoke, an unsupervised tool retrieval method designed to scale effectively to large toolsets without training. Specifically, we first generate a diverse set of synthetic queries that comprehensively cover different aspects of the query space associated with each tool document during the tool indexing phase. Second, we leverage LLM's query understanding capabilities to extract key tool-related context and underlying intents from user queries during the inference phase. Finally, we employ a novel multi-view similarity ranking strategy based on intents to pinpoint the most relevant tools for each query. Our evaluation demonstrates that Re-Invoke significantly outperforms state-of-the-art alternatives in both single-tool and multi-tool scenarios, all within a fully unsupervised setting. Notably, on the ToolE datasets, we achieve a 20% relative improvement in nDCG@5 for single-tool retrieval and a 39% improvement for multi-tool retrieval.

📄 PDF Abstract BibTeX arXiv:2408.01875

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Skill or Skip? Learning Selective Skill Invocation in Agentic Tasks via Dual-Granularity Preference Learning

2026-05-30 · Chishui Chen, Jiaye Lin, Te Sun, Junxi Wang 외 arxiv

Agent skills are callable procedural modules that provide reusable knowledge and execution policies for complex agentic tasks. However, existing methods mainly focus on selecting relevant skills or improving the skills t…

VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening

2026-07-28 · Syed Mhamudul Hasan, Anas AlSobeh, Hussein Zangoti, Abdur R. Shahid arxiv

We present VetClaw, an edge-cloud multimodal agentic system for early veterinary disease screening. VetClaw uses a camera module as an edge sensing device and sends captured images, together with optional symptom descrip…

Image Classification

Advancing and Benchmarking Personalized Tool Invocation for LLMs

2025-05-07 · Xu Huang, Yuefeng Huang, Weiwen Liu, Xingshan Zeng 외

Tool invocation is a crucial mechanism for extending the capabilities of Large Language Models (LLMs) and has recently garnered significant attention. It enables LLMs to solve complex problems through tool calls while ac…

BenchmarkingWorld Knowledge

Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM Reasoning

2026-05-19 · Qinghe Ma, Zhen Zhao, Yiming Wu, Jian Zhang 외 arxiv

Tool-augmented reasoning has emerged as a promising direction for enhancing the reasoning capabilities of multimodal large language models (MLLMs). However, existing studies mainly focus on enabling models to perform too…

Reinforcement Learning

PLAY2PROMPT: Zero-shot Tool Instruction Optimization for LLM Agents via Tool Play

2025-03-18 · Wei Fang, Yang Zhang, Kaizhi Qian, James Glass 외

Large language models (LLMs) are increasingly integrated with specialized external tools, yet many tasks demand zero-shot tool usage with minimal or noisy documentation. Existing solutions rely on manual rewriting or lab…