paper-with-me

홈 › Papers

Decision-aware User Simulation Agent for Evaluating Conversational Recommender Systems

2026-05-05 · Yuan-Chi Li, Li-Chi Chen, Sung-Yi Wu, Yu-Che Tsai, Shou-De Lin arxiv

Conversational recommender systems (CRS) increasingly rely on user simulators for automated evaluation of sales agents. A key requirement for such simulators is the ability to model human decision-making. However, most existing simulation frameworks do not explicitly model the internal decision process, and LLM-based simulators often exhibit unrealistically strong information-processing capabilities, rarely exhibit the hesitation or decision deferral commonly observed in real consumer behavior, resulting in overly high acceptance probabilities. To address this limitation, we propose Hesitator, a theory-grounded user simulation framework that explicitly models human decision-making under choice overload. The framework introduces a modular Decision Module that separates utility-based item selection from overload-aware commitment decisions. Experiments across multiple user simulation frameworks, domains, sales modes, and LLM backbones show that integrating our module consistently mitigates unrealistic behaviors under increasing overload conditions. Furthermore, Hesitator reproduces established behavioral patterns from psychological economics, demonstrating its ability to model human decision behavior.

📄 PDF Abstract BibTeX arXiv:2605.05250

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MapSatisfyBench: Benchmarking Satisfaction-Aware Map Agents through Behavior-Grounded Implicit Decision Factors

2026-06-16 · Lubin Bai, Mengyu Cao, Sixue Wang, Zhongwei Wan 외 arxiv

Large language model agents are increasingly integrated into map services. Since map services are embedded in everyday-life scenarios rather than professional task settings, users often express their needs informally, re…

Decision Making

Beyond Static Evaluation: Rethinking the Assessment of Personalized Agent Adaptability in Information Retrieval

2025-10-05 · Kirandeep Kaur, Preetam Prabhu Srikar Dammu, Hideo Joho, Chirag Shah arxiv

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve o…

Information Retrieval

Towards Content Provider Aware Recommender Systems: A Simulation Study on the Interplay between User and Provider Utilities

2021-05-06 · Ruohan Zhan, Konstantina Christakopoulou, Ya Le, Jayden Ooi 외

Most existing recommender systems focus primarily on matching users to content which maximizes user satisfaction on the platform. It is increasingly obvious, however, that content providers have a critical influence on u…

counterfactualRecommendation Systems

PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior

2026-05-12 · James Flemings, Murali Annavaram arxiv

Large language models (LLMs) are increasingly used to simulate human behavior, but their ability to simulate $individual$ privacy decisions is not well understood. In this paper, we address the problem of evaluating whet…

SimMOF: AI agent for Automated MOF Simulations

2026-03-31 · Jaewoong Lee, Taeun Bae, Jihan Kim arxiv

Metal-organic frameworks (MOFs) offer a vast design space, and as such, computational simulations play a critical role in predicting their structural and physicochemical properties. However, MOF simulations remain diffic…

Natural Language Queries