paper-with-me

홈 › Papers

Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews

2024-08-08 · Samantha Chan, Pat Pataranutaporn, Aditya Suri, Wazeer Zulfikar, Pattie Maes, Elizabeth F. Loftus

This study examines the impact of AI on human false memories -- recollections of events that did not occur or deviate from actual occurrences. It explores false memory induction through suggestive questioning in Human-AI interactions, simulating crime witness interviews. Four conditions were tested: control, survey-based, pre-scripted chatbot, and generative chatbot using a large language model (LLM). Participants (N=200) watched a crime video, then interacted with their assigned AI interviewer or survey, answering questions including five misleading ones. False memories were assessed immediately and after one week. Results show the generative chatbot condition significantly increased false memory formation, inducing over 3 times more immediate false memories than the control and 1.7 times more than the survey method. 36.4% of users' responses to the generative chatbot were misled through the interaction. After one week, the number of false memories induced by generative chatbots remained constant. However, confidence in these false memories remained higher than the control after one week. Moderating factors were explored: users who were less familiar with chatbots but more familiar with AI technology, and more interested in crime investigations, were more susceptible to false memories. These findings highlight the potential risks of using advanced AI in sensitive contexts, like police interviews, emphasizing the need for ethical considerations.

📄 PDF Abstract BibTeX arXiv:2408.04681

Code (1)

mitmedialab/ai-false-memories 공식 구현

Tasks

ChatbotLanguage ModellingLarge Language ModelSurvey

Similar Papers 제목 키워드 기반

ERR@HRI 2.0 Challenge: Multimodal Detection of Errors and Failures in Human-Robot Conversations

2025-07-17 · Shiye Cao, Maia Stiber, Amama Mahmood, Maria Teresa Parreira 외 arxiv

The integration of large language models (LLMs) into conversational robots has made human-robot conversations more dynamic. Yet, LLM-powered conversational robots remain prone to errors, e.g., misunderstanding user inten…

Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seeking

2024-02-08 · Nikhil Sharma, Q. Vera Liao, Ziang Xiao

Large language models (LLMs) powered conversational search systems have already been used by hundreds of millions of people, and are believed to bring many benefits over conventional search. However, while decades of res…

Conversational Search

Intelligent Depression Prevention via LLM-Based Dialogue Analysis: Overcoming the Limitations of Scale-Dependent Diagnosis through Precise Emotional Pattern Recognition

2025-04-23 · Zhenguang Zhong, Zhixuan Wang

Existing depression screening predominantly relies on standardized questionnaires (e.g., PHQ-9, BDI), which suffer from high misdiagnosis rates (18-34% in clinical studies) due to their static, symptom-counting nature an…

Conversational Swarm Intelligence, a Pilot Study

2023-08-31 · Louis Rosenberg, Gregg Willcox, Hans Schumann, Miles Bader 외

Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of c…

A Guiding Framework for K-12 Teachers in Creating AI-powered Learning Technologies through Vibe Coding

2026-06-09 · Yukyeong Song, Seoyeon Choi, Jinhee Kim, Yeongje Kim 외 arxiv

Large language models generate code from natural language prompts, enabling "vibe coding," which allows non-programmers to develop computational solutions. Vibe coding for teachers amplifies the value of teachers-as-desi…