paper-with-me

홈 › Papers

Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systems

2016-10-25 · Mengting Wan, Julian McAuley

Product review websites provide an incredible lens into the wide variety of opinions and experiences of different people, and play a critical role in helping users discover products that match their personal needs and preferences. To help address questions that can't easily be answered by reading others' reviews, some review websites also allow users to pose questions to the community via a question-answering (QA) system. As one would expect, just as opinions diverge among different reviewers, answers to such questions may also be subjective, opinionated, and divergent. This means that answering such questions automatically is quite different from traditional QA tasks, where it is assumed that a single correct' answer is available. While recent work introduced the idea of question-answering using product reviews, it did not account for two aspects that we consider in this paper: (1) Questions have multiple, often divergent, answers, and this full spectrum of answers should somehow be used to train the system; and (2) What makes a good' answer depends on the asker and the answerer, and these factors should be incorporated in order for the system to be more personalized. Here we build a new QA dataset with 800 thousand questions---and over 3.1 million answers---and show that explicitly accounting for personalization and ambiguity leads both to quantitatively better answers, but also a more nuanced view of the range of supporting, but subjective, opinions.

📄 PDF Abstract BibTeX arXiv:1610.08095

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering

Similar Papers 제목 키워드 기반

Diverging Preferences: When do Annotators Disagree and do Models Know?

2024-10-18 · Michael JQ Zhang, Zhilin Wang, Jena D. Hwang, Yi Dong 외

We examine diverging preferences in human-labeled preference datasets. We develop a taxonomy of disagreement sources spanning 10 categories across four high-level classes -- task underspecification, response style, refus…

Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference

2022-05-01 · Findings (ACL) 2022 5 · Yuxia Wang, Minghan Wang, Yimeng Chen, Shimin Tao 외

Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels due to its subjectivity. Several recent efforts have been made to acknowledge and embrace the existence of ambiguity, and explore ho…

Natural Language Inference

Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities

2023-11-01 · Senjuti Dutta, Sid Mittal, Sherol Chen, Deepak Ramachandran 외

The prevalence and impact of toxic discussions online have made content moderation crucial.Automated systems can play a vital role in identifying toxicity, and reducing the reliance on human moderation.Nevertheless, iden…

Language ModelingLanguage ModellingLarge Language Model

An opinion about opinions about opinions: subjectivity and the aggregate reader

2013-06-01 · NAACL 2013 6 · Asad Sayeed
Information RetrievalOpinion MiningSentiment Analysis

MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos

2016-06-20 · Amir Zadeh, Rowan Zellers, Eli Pincus, Louis-Philippe Morency

People are sharing their opinions, stories and reviews through online video sharing websites every day. Studying sentiment and subjectivity in these opinion videos is experiencing a growing attention from academia and in…

Sentiment AnalysisSubjectivity Analysis