paper-with-me

홈 › Papers

Agent-Centric Projection of Prompting Techniques and Implications for Synthetic Training Data for Large Language Models

2025-01-14 · Dhruv Dhamani, Mary Lou Maher

Recent advances in prompting techniques and multi-agent systems for Large Language Models (LLMs) have produced increasingly complex approaches. However, we lack a framework for characterizing and comparing prompting techniques or understanding their relationship to multi-agent LLM systems. This position paper introduces and explains the concepts of linear contexts (a single, continuous sequence of interactions) and non-linear contexts (branching or multi-path) in LLM systems. These concepts enable the development of an agent-centric projection of prompting techniques, a framework that can reveal deep connections between prompting strategies and multi-agent systems. We propose three conjectures based on this framework: (1) results from non-linear prompting techniques can predict outcomes in equivalent multi-agent systems, (2) multi-agent system architectures can be replicated through single-LLM prompting techniques that simulate equivalent interaction patterns, and (3) these equivalences suggest novel approaches for generating synthetic training data. We argue that this perspective enables systematic cross-pollination of research findings between prompting and multi-agent domains, while providing new directions for improving both the design and training of future LLM systems.

📄 PDF Abstract BibTeX arXiv:2501.07815

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The Tyranny of Possibilities in the Design of Task-Oriented LLM Systems: A Scoping Survey

2023-12-29 · Dhruv Dhamani, Mary Lou Maher

This scoping survey focuses on our current understanding of the design space for task-oriented LLM systems and elaborates on definitions and relationships among the available design parameters. The paper begins by defini…

Survey

Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systems

2026-02-23 · Moritz Weckbecker, Jonas Müller, Ben Hagag, Michael Mulet arxiv

Subliminal prompting is a phenomenon in which language models are biased towards certain concepts or traits through prompting with semantically unrelated tokens. While prior work has examined subliminal prompting in user…

Symbolic Learning Enables Self-Evolving Agents

2024-06-26 · Wangchunshu Zhou, Yixin Ou, Shengwei Ding, Long Li 외

The AI community has been exploring a pathway to artificial general intelligence (AGI) by developing "language agents", which are complex large language models (LLMs) pipelines involving both prompting techniques and too…

SMADE-IE: Sparse Multi-Agent Framework with Evidence-Driven Debate for Zero-Shot Information Extraction

2026-06-03 · Kenfeng Huang, Yi Cai, Xin Wu, Zikun Deng 외 arxiv

Zero-shot information extraction (IE) with large language models (LLMs) has attracted increasing attention due to its flexibility in adapting to new schemas and domains without task-specific training. Existing approaches…

Information Extraction

Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting

2022-06-08 · DiJia Su, Bertrand Douillard, Rami Al-Rfou, Cheolho Park 외

Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is…

Autonomous DrivingKnowledge DistillationMotion ForecastingMotion Planning+1