paper-with-me

Papers

BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis

2019-04-03 · NAACL 2019 6 · Hu Xu, Bing Liu, Lei Shu, Philip S. Yu

Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent success of machine reading comprehension (MRC) on formal documents, this paper explores the potential of turning customer reviews into a large source of knowledge that can be exploited to answer user questions.~We call this problem Review Reading Comprehension (RRC). To the best of our knowledge, no existing work has been done on RRC. In this work, we first build an RRC dataset called ReviewRC based on a popular benchmark for aspect-based sentiment analysis. Since ReviewRC has limited training examples for RRC (and also for aspect-based sentiment analysis), we then explore a novel post-training approach on the popular language model BERT to enhance the performance of fine-tuning of BERT for RRC. To show the generality of the approach, the proposed post-training is also applied to some other review-based tasks such as aspect extraction and aspect sentiment classification in aspect-based sentiment analysis. Experimental results demonstrate that the proposed post-training is highly effective. The datasets and code are available at https://www.cs.uic.edu/~hxu/.

📄 PDF Abstract BibTeX arXiv:1904.02232

Code (1)

howardhsu/BERT-for-RRC-ABSA pytorch

Tasks

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionReading ComprehensionSentiment Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization

2021-05-01 · Saurabh Jain, Guokai Tang, Lim Sze Chi

When making an online purchase, it becomes important for the customer to read the product reviews carefully and make a decision based on that. However, reviews can be lengthy, may contain repeated, or sometimes irrelevan…

Decision MakingMachine Reading ComprehensionReading ComprehensionTransfer Learning

Review Conversational Reading Comprehension

2019-02-03 · Hu Xu, Bing Liu, Lei Shu, Philip S. Yu

Inspired by conversational reading comprehension (CRC), this paper studies a novel task of leveraging reviews as a source to build an agent that can answer multi-turn questions from potential consumers of online business…

Language ModelingLanguage ModellingMachine Reading ComprehensionReading Comprehension

ForceReader: a BERT-based Interactive Machine Reading Comprehension Model with Attention Separation

2020-12-01 · COLING 2020 8 · Zheng Chen, Kangjian Wu

The release of BERT revolutionized the development of NLP. Various BERT-based reading comprehension models have been proposed, thus updating the performance ranking of reading comprehension tasks. However, the above BERT…

Machine Reading ComprehensionReading Comprehension

Reading Comprehension in Czech via Machine Translation and Cross-lingual Transfer

2020-07-03 · Kateřina Macková, Milan Straka

Reading comprehension is a well studied task, with huge training datasets in English. This work focuses on building reading comprehension systems for Czech, without requiring any manually annotated Czech training data. F…

Cross-Lingual TransferMachine TranslationReading ComprehensionTranslation

Giving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension

2019-08-31 · IJCNLP 2019 11 · Daniel Andor, Luheng He, Kenton Lee, Emily Pitler

Reading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading comprehension…

MathQuestion AnsweringReading Comprehension