paper-with-me

홈 › Papers

The Geometry of Dialogue: Graphing Language Models to Reveal Synergistic Teams for Multi-Agent Collaboration

2025-10-30 · Kotaro Furuya, Yuichi Kitagawa arxiv

While a multi-agent approach based on large language models (LLMs) represents a promising strategy to surpass the capabilities of single models, its success is critically dependent on synergistic team composition. However, forming optimal teams is a significant challenge, as the inherent opacity of most models obscures the internal characteristics necessary for effective collaboration. In this paper, we propose an interaction-centric framework for automatic team composition that does not require any prior knowledge including their internal architectures, training data, or task performances. Our method constructs a "language model graph" that maps relationships between models from the semantic coherence of pairwise conversations, and then applies community detection to identify synergistic model clusters. Our experiments with diverse LLMs demonstrate that the proposed method discovers functionally coherent groups that reflect their latent specializations. Priming conversations with specific topics identified synergistic teams which outperform random baselines on downstream benchmarks and achieve comparable accuracy to that of manually-curated teams based on known model specializations. Our findings provide a new basis for the automated design of collaborative multi-agent LLM teams.

📄 PDF Abstract BibTeX arXiv:2510.26352

Code (0)

등록된 구현이 없습니다.

Tasks

Community Detection

Similar Papers 제목 키워드 기반

Information Dynamics of Language Communication

2026-06-29 · Leonardo S. Goodall, Andrea I. Luppi, Pedro A. M. Mediano arxiv

Quantifying how meaning propagates through communicative exchanges remains underdeveloped in computational linguistics. Here we introduce an information-theoretic framework that quantifies the directed flow of semantic c…

The Geometry of Prompting: Unveiling Distinct Mechanisms of Task Adaptation in Language Models

2025-02-11 · Artem Kirsanov, Chi-Ning Chou, Kyunghyun Cho, SueYeon Chung

Decoder-only language models have the ability to dynamically switch between various computational tasks based on input prompts. Despite many successful applications of prompting, there is very limited understanding of th…

DecoderIn-Context Learning

MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing

2026-03-06 · Yang Liu, Jinxuan Cai, Yishen Li, Qi Meng 외 arxiv

Large language model-based (LLM-based) multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration. MAS workflows can be naturally modeled as directed compu…

MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialogue

2026-05-30 · Yue Jiang, Xue Jiang, Lihua Zhang, Zhiqiang Wang 외 arxiv

Multimodal large language models (MLLMs) demonstrate remarkable visual understanding, yet their reliability in interactive settings is severely undermined by hallucination snowballing: a phenomenon where initial errors a…

Visual Grounding

GPTA: Generative Prompt Tuning Assistant for Synergistic Downstream Neural Network Enhancement with LLMs

2024-03-29 · Xiao Liu, Jiawei Zhang

This study introduces GPTA, a Large Language Model assistance training framework, that enhances the training of downstream task models via prefix prompt. By minimizing data exposure to LLM, the framework addresses the se…

Language ModelingLanguage ModellingLarge Language Model