PrimeX: A Dataset of Worldview, Opinion, and Explanation
As the adoption of language models advances, so does the need to better represent individual users to the model. Are there aspects of an individual's belief system that a language model can utilize for improved alignment? Following prior research, we investigate this question in the domain of opinion prediction by developing PrimeX, a dataset of public opinion survey data from 858 US residents with two additional sources of belief information: written explanations from the respondents for why they hold specific opinions, and the Primal World Belief survey for assessing respondent worldview. We provide an extensive initial analysis of our data and show the value of belief explanations and worldview for personalizing language models. Our results demonstrate how the additional belief information in PrimeX can benefit both the NLP and psychological research communities, opening up avenues for further study.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CommunityLM: Probing Partisan Worldviews from Language Models
As political attitudes have diverged ideologically in the United States, political speech has diverged lingusitically. The ever-widening polarization between the US political parties is accelerated by an erosion of mutua…
SurveyA model of opinion dynamics with echo chambers explains the spatial distribution of vaccine hesitancy
Vaccination hesitancy is a major obstacle to achieving and maintaining herd immunity. It is therefore of prime importance for public health authorities to understand the dynamics of an anti-vaccine opinion in the populat…
Constructing Explainable Opinion Graphs from Review
The Web is a major resource of both factual and subjective information. While there are significant efforts to organize factual information into knowledge bases, there is much less work on organizing opinions, which are …
Finding Uncommon Ground: A Human-Centered Model for Extrospective Explanations
The need for explanations in AI has, by and large, been driven by the desire to increase the transparency of black-box machine learning models. However, such explanations, which focus on the internal mechanisms that lead…
Learning to Rank Aspects and Opinions for Comparative Explanations
Comparative recommendation explanations help to make sense of recommendations by comparing a recommended item along some aspects of interest with one or many items being considered. This work extends the notion of compar…
Explainable RecommendationLearning-To-Rank