AI Revolution on Chat Bot: Evidence from a Randomized Controlled Experiment
In recent years, generative AI has undergone major advancements, demonstrating significant promise in augmenting human productivity. Notably, large language models (LLM), with ChatGPT-4 as an example, have drawn considerable attention. Numerous articles have examined the impact of LLM-based tools on human productivity in lab settings and designed tasks or in observational studies. Despite recent advances, field experiments applying LLM-based tools in realistic settings are limited. This paper presents the findings of a field randomized controlled trial assessing the effectiveness of LLM-based tools in providing unmonitored support services for information retrieval.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesInformation RetrievalRetrievalSimilar Papers 제목 키워드 기반
Evidence Type Classification in Randomized Controlled Trials
Randomized Controlled Trials (RCT) are a common type of experimental studies in the medical domain for evidence-based decision making. The ability to automatically extract the \textit{arguments} proposed therein can be o…
Argument MiningClassificationDecision MakingGeneral Classification+1Can AI Help You Get Over Your Breakup? One Session with a Belief-Reframing Chatbot Shows Sustained Distress Reduction
Romantic breakups are among the most common and intense sources of psychological distress. We evaluated *overit*, a single-session AI chatbot that uses cognitive reappraisal to address breakup distress, informed by memor…
Large Language Models are often politically extreme, usually ideologically inconsistent, and persuasive even in informational contexts
Large Language Models (LLMs) are a transformational technology, fundamentally changing how people obtain information and interact with the world. As people become increasingly reliant on them for an enormous variety of t…
ChatbotPersuasivenessInvestigating Affective Use and Emotional Well-being on ChatGPT
As AI chatbots see increased adoption and integration into everyday life, questions have been raised about the potential impact of human-like or anthropomorphic AI on users. In this work, we investigate the extent to whi…
Privacy PreservingTowards Understanding of Medical Randomized Controlled Trials by Conclusion Generation
Randomized controlled trials (RCTs) represent the paramount evidence of clinical medicine. Using machines to interpret the massive amount of RCTs has the potential of aiding clinical decision-making. We propose a RCT con…
Decision MakingLanguage ModelingLanguage ModellingSentence+1