Private Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recovery
Eating disorders (ED) are complex mental health conditions that require long-term management and support. Recent advancements in large language model (LLM)-based chatbots offer the potential to assist individuals in receiving immediate support. Yet, concerns remain about their reliability and safety in sensitive contexts such as ED. We explore the opportunities and potential harms of using LLM-based chatbots for ED recovery. We observe the interactions between 26 participants with ED and an LLM-based chatbot, WellnessBot, designed to support ED recovery, over 10 days. We discovered that our participants have felt empowered in recovery by discussing ED-related stories with the chatbot, which served as a personal yet social avenue. However, we also identified harmful chatbot responses, especially concerning individuals with ED, that went unnoticed partly due to participants' unquestioning trust in the chatbot's reliability. Based on these findings, we provide design implications for safe and effective LLM-based interventions in ED management.
Code (0)
등록된 구현이 없습니다.
Tasks
ChatbotLanguage ModelingLanguage ModellingLarge Language ModelManagementSimilar Papers 제목 키워드 기반
AI Chaperones Are (Really) All You Need to Prevent Parasocial Relationships with Chatbots
Emerging reports of the harms caused to children and adults by AI sycophancy and by parasocial ties with chatbots point to an urgent need for safeguards against such risks. Yet, preventing such dynamics is challenging: p…
You Don't Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers' Private Personas
Social chatbots, also known as chit-chat chatbots, evolve rapidly with large pretrained language models. Despite the huge progress, privacy concerns have arisen recently: training data of large language models can be ext…
Language ModelingLanguage ModellingYou Don’t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers’ Private Personas
Social chatbots, also known as chit-chat chatbots, evolve rapidly with large pretrained language models. Despite the huge progress, privacy concerns have arisen recently: training data of large language models can be ext…
Language ModelingLanguage ModellingUnderstanding How International Students in the U.S. Are Using Conversational AI to Support Cross-Cultural Adaptation
Moving to a new culture and adapting to a new life, as an international student, can be a stressful experience. In the US, international students face unique overlapping challenges, yet the current support ecosystem, inc…
The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support
People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence s…
Language ModelingLanguage ModellingLarge Language ModelNavigate