paper-with-me

홈 › Papers

Large Language Models Should Ask Clarifying Questions to Increase Confidence in Generated Code

2023-08-25 · Jie JW Wu

Large language models (LLMs) have significantly improved the ability to perform tasks in the field of code generation. However, there is still a gap between LLMs being capable coders and being top-tier software engineers. Based on the observation that toplevel software engineers often ask clarifying questions to reduce ambiguity in both requirements and coding solutions, I argue that the same should be applied to LLMs for code generation tasks. By asking probing questions in various topics before generating the final code, the challenges of programming with LLMs, such as unclear intent specification, lack of computational thinking, and undesired code quality, may be alleviated. This, in turn, increases confidence in the generated code. In this work, I explore how to leverage better communication skills to achieve greater confidence in generated code. I propose a communication-centered process that uses an LLM-generated communicator to identify issues with high ambiguity or low confidence in problem descriptions and generated code. I then ask clarifying questions to obtain responses from users for refining the code.

📄 PDF Abstract BibTeX arXiv:2308.13507

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Similar Papers 제목 키워드 기반

Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding

2021-09-25 · Joo-Kyung Kim, Guoyin Wang, Sungjin Lee, Young-Bum Kim

A large-scale conversational agent can suffer from understanding user utterances with various ambiguities such as ASR ambiguity, intent ambiguity, and hypothesis ambiguity. When ambiguities are detected, the agent should…

Spoken Language Understanding

Do Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search

2026-02-09 · Clemencia Siro, Zahra Abbasiantaeb, Yifei Yuan, Mohammad Aliannejadi 외 arxiv

Conversational search systems increasingly employ clarifying questions to refine user queries and improve the search experience. Previous studies have demonstrated the usefulness of text-based clarifying questions in enh…

Question Answering

Analysing the Effect of Clarifying Questions on Document Ranking in Conversational Search

2020-08-09 · Antonios Minas Krasakis, Mohammad Aliannejadi, Nikos Voskarides, Evangelos Kanoulas

Recent research on conversational search highlights the importance of mixed-initiative in conversations. To enable mixed-initiative, the system should be able to ask clarifying questions to the user. However, the ability…

Conversational SearchDocument Ranking

Asking Clarifying Questions for Preference Elicitation With Large Language Models

2025-10-13 · Ali Montazeralghaem, Guy Tennenholtz, Craig Boutilier, Ofer Meshi arxiv

Large Language Models (LLMs) have made it possible for recommendation systems to interact with users in open-ended conversational interfaces. In order to personalize LLM responses, it is crucial to elicit user preference…

Recommendation Systems

Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

2021-09-13 · EMNLP 2021 11 · Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton 외

Enabling open-domain dialogue systems to ask clarifying questions when appropriate is an important direction for improving the quality of the system response. Namely, for cases when a user request is not specific enough …