paper-with-me

홈 › Papers

Intention and Context Elicitation with Large Language Models in the Legal Aid Intake Process

2023-11-22 · Nick Goodson, Rongfei Lu

Large Language Models (LLMs) and chatbots show significant promise in streamlining the legal intake process. This advancement can greatly reduce the workload and costs for legal aid organizations, improving availability while making legal assistance more accessible to a broader audience. However, a key challenge with current LLMs is their tendency to overconfidently deliver an immediate 'best guess' to a client's question based on the output distribution learned over the training data. This approach often overlooks the client's actual intentions or the specifics of their legal situation. As a result, clients may not realize the importance of providing essential additional context or expressing their underlying intentions, which are crucial for their legal cases. Traditionally, logic based decision trees have been used to automate intake for specific access to justice issues, such as immigration and eviction. But those solutions lack scalability. We demonstrate a proof-of-concept using LLMs to elicit and infer clients' underlying intentions and specific legal circumstances through free-form, language-based interactions. We also propose future research directions to use supervised fine-tuning or offline reinforcement learning to automatically incorporate intention and context elicitation in chatbots without explicit prompting.

📄 PDF Abstract BibTeX arXiv:2311.13281

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RPS: Information Elicitation with Reinforcement Prompt Selection

2026-04-15 · Tao Wang, Jingyao Lu, Xibo Wang, Haonan Huang 외 arxiv

Large language models (LLMs) have shown remarkable capabilities in dialogue generation and reasoning, yet their effectiveness in eliciting user-known but concealed information in open-ended conversations remains limited.…

Reinforcement LearningDialogue Generation

Harnessing GPT-3.5-turbo for Rhetorical Role Prediction in Legal Cases

2023-10-26 · Anas Belfathi, Nicolas Hernandez, Laura Monceaux

We propose a comprehensive study of one-stage elicitation techniques for querying a large pre-trained generative transformer (GPT-3.5-turbo) in the rhetorical role prediction task of legal cases. This task is known as re…

Opus: A Prompt Intention Framework for Complex Workflow Generation

2025-07-15 · Théo Fagnoni, Mahsun Altın, Chia En Chung, Phillip Kingston 외

This paper introduces the Opus Prompt Intention Framework, designed to improve complex Workflow Generation with instruction-tuned Large Language Models (LLMs). We propose an intermediate Intention Capture layer between u…

The Elicitation Game: Evaluating Capability Elicitation Techniques

2025-02-04 · Felix Hofstätter, Teun van der Weij, Jayden Teoh, Henning Bartsch 외

Capability evaluations are required to understand and regulate AI systems that may be deployed or further developed. Therefore, it is important that evaluations provide an accurate estimation of an AI system's capabiliti…

Code Generation

Is Reasoning All You Need? Probing Bias in the Age of Reasoning Language Models

2025-07-03 · Riccardo Cantini, Nicola Gabriele, Alessio Orsino, Domenico Talia

Reasoning Language Models (RLMs) have gained traction for their ability to perform complex, multi-step reasoning tasks through mechanisms such as Chain-of-Thought (CoT) prompting or fine-tuned reasoning traces. While the…

Adversarial RobustnessAllFairness