paper-with-me

홈 › Papers

"Death" of a Chatbot: Investigating and Designing Toward Psychologically Safe Endings for Human-AI Relationships

2026-02-06 · Rachel Poonsiriwong, Chayapatr Archiwaranguprok, Pat Pataranutaporn arxiv

Millions of users form emotional attachments to AI companions like Character AI, Replika, and ChatGPT. When these relationships end through model updates, safety interventions, or platform shutdowns, users receive no closure, reporting grief comparable to human loss. As regulations mandate protections for vulnerable users, discontinuation events will accelerate, yet no platform has implemented deliberate end-of-"life" design. Through grounded theory analysis of AI companion communities, we find that discontinuation is a sense-making process shaped by how users attribute agency, perceive finality, and anthropomorphize their companions. Strong anthropomorphization co-occurs with intense grief; users who perceive change as reversible become trapped in fixing cycles; while user-initiated endings demonstrate greater closure. Synthesizing grief psychology with Self-Determination Theory, we develop four design principles and artifacts demonstrating how platforms might provide closure and orient users toward human connection. We contribute the first framework for designing psychologically safe AI companion discontinuation.

📄 PDF Abstract BibTeX arXiv:2602.07193

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Piece of Theatre: Investigating How Teachers Design LLM Chatbots to Assist Adolescent Cyberbullying Education

2024-02-27 · Michael A. Hedderich, Natalie N. Bazarova, Wenting Zou, Ryun Shim 외

Cyberbullying harms teenagers' mental health, and teaching them upstanding intervention is crucial. Wizard-of-Oz studies show chatbots can scale up personalized and interactive cyberbullying education, but implementing s…

Chatbot

Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbots

2022-09-07 · Wai Man Si, Michael Backes, Jeremy Blackburn, Emiliano De Cristofaro 외

Chatbots are used in many applications, e.g., automated agents, smart home assistants, interactive characters in online games, etc. Therefore, it is crucial to ensure they do not behave in undesired manners, providing of…

ChatbotComputer Security

A Multimodal Manufacturing Safety Chatbot: Knowledge Base Design, Benchmark Development, and Evaluation of Multiple RAG Approaches

2025-11-14 · Ryan Singh, Austin Hamilton, Amanda White, Michael Wise 외 arxiv

Ensuring worker safety remains a critical challenge in modern manufacturing environments. Industry 5.0 reorients the prevailing manufacturing paradigm toward more human-centric operations. Using a design science research…

AI-induced sexual harassment: Investigating Contextual Characteristics and User Reactions of Sexual Harassment by a Companion Chatbot

2025-04-05 · Mohammad, Namvarpour, Harrison Pauwels, Afsaneh Razi

Advancements in artificial intelligence (AI) have led to the increase of conversational agents like Replika, designed to provide social interaction and emotional support. However, reports of these AI systems engaging in …

Chatbot

FACTS About Building Retrieval Augmented Generation-based Chatbots

2024-07-10 · Rama Akkiraju, Anbang Xu, Deepak Bora, Tan Yu 외

Enterprise chatbots, powered by generative AI, are emerging as key applications to enhance employee productivity. Retrieval Augmented Generation (RAG), Large Language Models (LLMs), and orchestration frameworks like Lang…

RAGRerankingRetrievalRetrieval-augmented Generation