paper-with-me

홈 › Papers

EVINCE: Optimizing Multi-LLM Dialogues Using Conditional Statistics and Information Theory

2024-08-26 · Edward Y. Chang

EVINCE (Entropy and Variation IN Conditional Exchanges) is a novel framework for optimizing multi-LLM dialogues using conditional statistics and information theory. It addresses limitations in multi-agent debate (MAS) frameworks, where multiple LLMs ``chat'' without behavior modulation or mutual information quality assessment. Using dual entropy optimization to balance perspective diversity and prior knowledge, $\EVINCE$ provides quantitative tools to dynamically regulate LLM linguistic behaviors. When mutual information is low and both cross-entropy and Wasserstein distance are high, EVINCE promotes contentious dialogues to expose diverse perspectives and uncover inconsistencies. Conversely, as cross-entropy decreases and mutual information stabilizes, it transitions discussions into a conciliatory phase, encouraging compromise and acknowledgment of valid points. Using information-theoretic metrics and optimizing mutual information, $\EVINCE$ emerges as a structured and highly effective framework for multi-LLM collaboration.

📄 PDF Abstract BibTeX arXiv:2408.14575

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDiversityvalid

Similar Papers 제목 키워드 기반

Ensuring Ground Truth Accuracy in Healthcare with the EVINCE framework

2024-05-20 · Edward Y. Chang

Misdiagnosis is a significant issue in healthcare, leading to harmful consequences for patients. The propagation of mislabeled data through machine learning models into clinical practice is unacceptable. This paper propo…

Diagnostic

Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues

2020-05-01 · LREC 2020 5 · Costanza Navarretta, Patrizia Paggio

This paper deals with the annotation of dialogue acts in a multimodal corpus of first encounter dialogues, i.e. face-to- face dialogues in which two people who meet for the first time talk with no particular purpose othe…

Descriptive

Conversational Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis

2023-09-27 · Ildikó Pilán, Laurent Prévot, Hendrik Buschmeier, Pierre Lison

Scripted dialogues such as movie and TV subtitles constitute a widespread source of training data for conversational NLP models. However, there are notable linguistic differences between these dialogues and spontaneous i…

Language ModelingLanguage ModellingLarge Language Model

Uncovering Biases with Reflective Large Language Models

2024-08-24 · Edward Y. Chang

Biases and errors in human-labeled data present significant challenges for machine learning, especially in supervised learning reliant on potentially flawed ground truth data. These flaws, including diagnostic errors and…

Bias DetectionDiagnostic

Open Domain Dialogue Generation with Latent Images

2020-04-04 · Ze Yang, Wei Wu, Huang Hu, Can Xu 외

We consider grounding open domain dialogues with images. Existing work assumes that both an image and a textual context are available, but image-grounded dialogues by nature are more difficult to obtain than textual dial…

Dialogue GenerationImage GenerationResponse GenerationText to Image Generation+1