ComplLLM: Fine-tuning LLMs to Discover Complementary Signals for Decision-making
Multi-agent decision pipelines can outperform single agent workflows when complementarity holds, i.e., different agents bring unique information to the table to inform a final decision. We propose ComplLLM, a post-training framework based on decision theory that fine-tunes a decision-assistant LLM using complementary information as reward to output signals that complement existing agent decisions. We validate ComplLLM on synthetic and real-world tasks involving domain experts, demonstrating how the approach recovers known complementary information and produces plausible explanations of complementary signals to support downstream decision-makers.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
AInstein: Can LLMs Solve Research Problems From Parametric Memory Alone?
Can large language models solve AI research problems using only their parametric knowledge, without fine-tuning, retrieval, or other external aids? We introduce AInstein, a framework for testing whether LLM agents can ge…
Prompt and Parameter Co-Optimization for Large Language Models
Prompt optimization and fine-tuning are two major approaches to improve the performance of Large Language Models (LLMs). They enhance the capabilities of LLMs from complementary perspectives: the former through explicit …
Large Language Model based Smart Contract Auditing with LLMBugScanner
This paper presents LLMBugScanner, a large language model (LLM) based framework for smart contract vulnerability detection using fine-tuning and ensemble learning. Smart contract auditing presents several challenges for …
Vulnerability DetectionEnsemble LearningStructured Extraction of Process Structure Properties Relationships in Materials Science
With the advent of large language models (LLMs), the vast unstructured text within millions of academic papers is increasingly accessible for materials discovery, although significant challenges remain. While LLMs offer …
Uncertainty QuantificationZero-Shot LearningTowards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks
Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversariall…
Instruction FollowingSafety Alignment