ToolChoiceConfusion: Causal Minimal Tool Filtering for Reliable LLM Agents

2026-06-04 · Rahul Suresh Babu, Laxmipriya Ganesh Iyer arxiv

Large language model agents increasingly rely on external tools, but larger tool menus can reduce reliability and efficiency by increasing wrong-tool calls, premature actions, and token cost. Existing tool-selection methods often optimize semantic relevance, exposing tools whose names or descriptions match the user request. We argue that relevance is insufficient: a tool may be related to the task while still being unnecessary or premature at the current step. We propose Causal Minimal Tool Filtering (CMTF), a training-free method that selects tools by causal sufficiency. CMTF uses lightweight precondition-effect contracts to expose only the minimal next-step tool frontier needed to advance from the current state toward the user goal. Across multi-step tool-use tasks, we compare CMTF with all-tools exposure, keyword retrieval, state-aware filtering, and causal-path ablations, measuring task success, wrong-tool calls, premature actions, tool exposure, and token cost. In the main benchmark with 102 tasks, 100 tools, four LLM backends, and 2448 task-method-model runs, CMTF matches the strongest causal baseline in aggregate success while reducing visible tools from 100 to one per step and reducing token usage by about 90% relative to all-tools exposure.

📄 PDF Abstract BibTeX arXiv:2606.06284

Code (0)

등록된 구현이 없습니다.

GIST-CMTF: Goal-State Inference for Causal Minimal Tool Filtering in LLM Agents

2026-06-15 · Rahul Suresh Babu, Rohit Shukla arxiv

Tool-augmented LLM agents rely on runtime filtering to decide which tools should be visible at each step. Causal Minimal Tool Filtering (CMTF) reduces tool-choice confusion by exposing only the next causally necessary to…

ToolMenuBench: Benchmarking Tool-Menu Filtering Strategies for Reliable and Efficient LLM Agents

2026-06-13 · Rahul Suresh Babu, Laxmipriya Ganesh Iyer arxiv

Tool-augmented large language model agents increasingly operate over large tool libraries, but existing evaluations often focus on whether a model can call a tool correctly rather than how the visible tool menu shapes re…

Contract2Tool: Learning Preconditions and Effects for Reliable Tool-Augmented LLM Agents

2026-06-05 · Rahul Suresh Babu, Laxmipriya Ganesh Iyer arxiv

Tool-augmented large language model agents increasingly rely on external APIs, but standard tool schemas describe how to call a tool, not when the tool is causally appropriate or what task state it produces. Causal tool …

CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures

2026-05-25 · Akash Bonagiri, Devang Borkar, Gerard Janno Anderias, Setareh Rafatirad 외 arxiv

Large language model (LLM) agents frequently fail on multi-step tasks involving reasoning, tool use, and environment interaction. While such failures are typically logged or retried heuristically, they contain structured…

Mathematical Reasoning Question Answering Code Generation

MEEPTOOLS: A maximum expected error based FASTQ read filtering and trimming toolkit

2015-12-10

Next generation sequencing technology rapidly produces massive volume of data and quality control of this sequencing data is essential to any genomic analysis. Here we present MEEPTOOLS, which is a collection of open-sou…