Co-Writing with Opinionated Language Models Affects Users' Views
If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write - and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Aspect-Based Opinion Extraction from Customer reviews
Text is the main method of communicating information in the digital age. Messages, blogs, news articles, reviews, and opinionated information abound on the Internet. People commonly purchase products online and post thei…
ArticlesDecision MakingTAGExplainable Recommendation via Multi-Task Learning in Opinionated Text Data
Explaining automatically generated recommendations allows users to make more informed and accurate decisions about which results to utilize, and therefore improves their satisfaction. In this work, we develop a multi-tas…
Explainable RecommendationMulti-Task LearningTowards Full Authorship with AI: Supporting Revision with AI-Generated Views
Large language models (LLMs) are shaping a new user interface (UI) paradigm in writing tools by enabling users to generate text through prompts. This paradigm shifts some creative control from the user to the system, the…
Prompt EngineeringText GenerationWriting user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviews
The goal of this paper is establishing if we can satisfactorily perform a Thematic Analysis (TA) of semi-structured interviews using a Large Language Model (more precisely GPT3.5-Turbo). Building on previous work by the …
Language ModelingLanguage ModellingLarge Language ModelData-Driven Broad-Coverage Grammars for Opinionated Natural Language Generation (ONLG)
Opinionated Natural Language Generation (ONLG) is a new, challenging, task that aims to automatically generate human-like, subjective, responses to opinionated articles online. We present a data-driven architecture for O…
ArticlesLanguage ModelingLanguage ModellingText Generation+1