Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects
As generative artificial intelligence (AI) enables the creation and dissemination of information at massive scale and speed, it is increasingly important to understand how people perceive AI-generated content. One prominent policy proposal requires explicitly labeling AI-generated content to increase transparency and encourage critical thinking about the information, but prior research has not yet tested the effects of such labels. To address this gap, we conducted a survey experiment (N=1601) on a diverse sample of Americans, presenting participants with an AI-generated message about several public policies (e.g., allowing colleges to pay student-athletes), randomly assigning whether participants were told the message was generated by (a) an expert AI model, (b) a human policy expert, or (c) no label. We found that messages were generally persuasive, influencing participants' views of the policies by 9.74 percentage points on average. However, while 94.6% of participants assigned to the AI and human label conditions believed the authorship labels, labels had no significant effects on participants' attitude change toward the policies, judgments of message accuracy, nor intentions to share the message with others. These patterns were robust across a variety of participant characteristics, including prior knowledge of the policy, prior experience with AI, political party, education level, or age. Taken together, these results imply that, while authorship labels would likely enhance transparency, they are unlikely to substantially affect the persuasiveness of the labeled content, highlighting the need for alternative strategies to address challenges posed by AI-generated information.
Code (1)
Tasks
PersuasivenessSimilar Papers 제목 키워드 기반
The effect of source disclosure on evaluation of AI-generated messages: A two-part study
Advancements in artificial intelligence (AI) over the last decade demonstrate that machines can exhibit communicative behavior and influence how humans think, feel, and behave. In fact, the recent development of ChatGPT …
Comparing Large Language Model AI and Human-Generated Coaching Messages for Behavioral Weight Loss
Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intellige…
Language ModelingLanguage ModellingLarge Language ModelOPTIC: Optimizing Patient-Provider Triaging & Improving Communications in Clinical Operations using GPT-4 Data Labeling and Model Distillation
The COVID-19 pandemic has accelerated the adoption of telemedicine and patient messaging through electronic medical portals (patient medical advice requests, or PMARs). While these platforms enhance patient access to hea…
Prompt EngineeringSpecificityHow effective are covid-19 vaccine health messages in reducing vaccine skepticism? Heterogeneity in messages effectiveness by just world beliefs
To end the COVID-19 pandemic, policymakers have relied on various public health messages to boost vaccine take-up rates amongst people across wide political spectra, backgrounds, and worldviews. However, much less is und…
Coordinating Policies Among Multiple Agents via an Intelligent Communication Channel
In Multi-Agent Reinforcement Learning (MARL), specialized channels are often introduced that allow agents to communicate directly with one another. In this paper, we propose an alternative approach whereby agents communi…
Intelligent CommunicationMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)