paper-with-me

홈 › Papers

When to Ask a Question: Understanding Communication Strategies in Generative AI Tools

2026-05-11 · Charlotte Park, Kate Donahue, Manish Raghavan arxiv

Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on the models to infer and fill in under-specified information based on distributional knowledge of user preferences. Such inferences may privilege majority viewpoints and disadvantage users with atypical preferences, raising concerns about fairness. Unlike more traditional recommender systems, LLMs can explicitly solicit more information from users through natural language. However, while directly eliciting user preferences could increase personalization and mitigate inequality, excessive querying places a burden on users who value efficiency. We develop a stylized model of user-LLM interaction and develop an objective that captures tradeoff between user burden and preference representation. Building on the observation that individual preferences are often correlated, we analyze how AI systems should balance inference and elicitation, characterizing the optimal amount of information to solicit before content generation. Ultimately, we show that information elicitation can mitigate the systematic biases of preference inference, enabling the design of generative tools that better incorporate diverse user perspectives while maintaining efficiency. We complement this theoretical analysis with an empirical evaluation illustrating the model's predictions and exploring their practical implications.

📄 PDF Abstract BibTeX arXiv:2605.11240

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Prompts: Learning from Human Communication for Enhanced AI Intent Alignment

2024-05-09 · Yoonsu Kim, Kihoon Son, Seoyoung Kim, Juho Kim

AI intent alignment, ensuring that AI produces outcomes as intended by users, is a critical challenge in human-AI interaction. The emergence of generative AI, including LLMs, has intensified the significance of this prob…

The Provenance Problem: LLMs and the Breakdown of Citation Norms

2025-09-15 · Brian D. Earp, Haotian Yuan, Julian Koplin, Sebastian Porsdam Mann arxiv

The increasing use of generative AI in scientific writing raises urgent questions about attribution and intellectual credit. When a researcher employs ChatGPT to draft a manuscript, the resulting text may echo ideas from…

Investigating Reinforcement Learning for Communication Strategies in a Task-Initiative Setting

2023-08-03 · Baber Khalid, Matthew Stone

Many conversational domains require the system to present nuanced information to users. Such systems must follow up what they say to address clarification questions and repair misunderstandings. In this work, we explore …

reinforcement-learning

Contextual Confidence and Generative AI

2023-11-02 · Shrey Jain, Zoë Hitzig, Pamela Mishkin

Generative AI models perturb the foundations of effective human communication. They present new challenges to contextual confidence, disrupting participants' ability to identify the authentic context of communication and…

AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed Bandit

2024-09-20 · Mohanna Hoveyda, Arjen P. de Vries, Maarten de Rijke, Harrie Oosterhuis 외

In question answering (QA), different questions can be effectively addressed with different answering strategies. Some require a simple lookup, while others need complex, multi-step reasoning to be answered adequately. T…

Question Answering