Retcon -- a Prompt-Based Technique for Precise Control of LLMs in Conversations
Recent advances in Large Language Models (LLMs) allow agents to execute complex natural language tasks. Many LLM applications, such as support agents, teaching assistants, and interactive bots, involve multi-turn conversations. However, it remains challenging to control LLMs in the context of such interactions, particularly when the LLM behavior needs to be adjustable over the course of the conversation. In this paper, we present Retcon, a few-shot prompting technique designed to provide turn-level control over LLMs in conversations. We then demonstrate that it performs significantly better than zero-shot and traditional few-shot prompting.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Plan-and-Write: Structure-Guided Length Control for LLMs without Model Retraining
Length control in Large Language Models (LLMs) is a crucial but under-addressed challenge, with applications ranging from voice interfaces requiring concise responses to research summaries needing comprehensive outputs. …
Document SummarizationPrompt EngineeringUniversal and Context-Independent Triggers for Precise Control of LLM Outputs
Large language models (LLMs) have been widely adopted in applications such as automated content generation and even critical decision-making systems. However, the risk of prompt injection allows for potential manipulatio…
Decision MakingControlled Text Generation via Language Model Arithmetic
As Large Language Models (LLMs) are deployed more widely, customization with respect to vocabulary, style, and character becomes more important. In this work, we introduce model arithmetic, a novel inference framework fo…
Language ModelingLanguage ModellingmodelText GenerationA Mixture of Linear Corrections Generates Secure Code
Large language models (LLMs) have become proficient at sophisticated code-generation tasks, yet remain ineffective at reliably detecting or avoiding code vulnerabilities. Does this deficiency stem from insufficient learn…
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
While the real world is inherently stochastic, Large Language Models (LLMs) are predominantly evaluated on single-round inference against fixed ground truths. In this work, we shift the lens to distribution alignment: as…
Prompt Engineering