BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent success of machine reading comprehension (MRC) on formal documents, this paper explores the potential of turning customer reviews into a large source of knowledge that can be exploited to answer user questions.~We call this problem Review Reading Comprehension (RRC). To the best of our knowledge, no existing work has been done on RRC. In this work, we first build an RRC dataset called ReviewRC based on a popular benchmark for aspect-based sentiment analysis. Since ReviewRC has limited training examples for RRC (and also for aspect-based sentiment analysis), we then explore a novel post-training approach on the popular language model BERT to enhance the performance of fine-tuning of BERT for RRC. To show the generality of the approach, the proposed post-training is also applied to some other review-based tasks such as aspect extraction and aspect sentiment classification in aspect-based sentiment analysis. Experimental results demonstrate that the proposed post-training is highly effective. The datasets and code are available at https://www.cs.uic.edu/~hxu/.
Code (1)
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionReading ComprehensionSentiment ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization
When making an online purchase, it becomes important for the customer to read the product reviews carefully and make a decision based on that. However, reviews can be lengthy, may contain repeated, or sometimes irrelevan…
Decision MakingMachine Reading ComprehensionReading ComprehensionTransfer LearningReview Conversational Reading Comprehension
Inspired by conversational reading comprehension (CRC), this paper studies a novel task of leveraging reviews as a source to build an agent that can answer multi-turn questions from potential consumers of online business…
Language ModelingLanguage ModellingMachine Reading ComprehensionReading ComprehensionForceReader: a BERT-based Interactive Machine Reading Comprehension Model with Attention Separation
The release of BERT revolutionized the development of NLP. Various BERT-based reading comprehension models have been proposed, thus updating the performance ranking of reading comprehension tasks. However, the above BERT…
Machine Reading ComprehensionReading ComprehensionReading Comprehension in Czech via Machine Translation and Cross-lingual Transfer
Reading comprehension is a well studied task, with huge training datasets in English. This work focuses on building reading comprehension systems for Czech, without requiring any manually annotated Czech training data. F…
Cross-Lingual TransferMachine TranslationReading ComprehensionTranslationGiving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension
Reading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading comprehension…
MathQuestion AnsweringReading Comprehension