Explicit Document Modeling through Weighted Multiple-Instance Learning
Representing documents is a crucial component in many NLP tasks, for instance predicting aspect ratings in reviews. Previous methods for this task treat documents globally and do not acknowledge that target categories are often assigned by their authors with generally no indication of the specific sentences that motivate them. To address this issue, we adopt a weakly supervised learning model, which jointly learns to focus on relevant parts of a document according to the context along with a classifier for the target categories. Originated from the weighted multiple-instance regression (MIR) framework, the modellearns decomposable document vectors for each individual category and thus overcomesthe representational bottleneck in previous methods due to a fixed-length document vector. During prediction, the estimated relevance or saliency weights explicitly capture the contribution of each sentence to the predicted rating, thus offering an explanation of the rating. Our model achieves state-of-the-art performance on multi-aspect sentiment analysis, improving over several baselines. Moreover, the predicted saliency weights are close to human estimates obtained by crowdsourcing and increase the performance of lexical and topical features for review segmentation and summarization.
Code (1)
Tasks
Multiple Instance LearningSentenceSentiment AnalysisWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Weighted Global Normalization for Multiple Choice Reading Comprehension over Long Documents
Motivated by recent evidence pointing out the fragility of high-performing span prediction models, we direct our attention to multiple choice reading comprehension. In particular, this work introduces a novel method for …
Answer SelectionMultiple-choicePredictionReading ComprehensionTopic Modeling as Multi-Objective Contrastive Optimization
Recent representation learning approaches enhance neural topic models by optimizing the weighted linear combination of the evidence lower bound (ELBO) of the log-likelihood and the contrastive learning objective that con…
Contrastive LearningDiversityRepresentation LearningTopic ModelsImproving Event Coreference Resolution by Modeling Correlations between Event Coreference Chains and Document Topic Structures
This paper proposes a novel approach for event coreference resolution that models correlations between event coreference chains and document topical structures through an Integer Linear Programming formulation. We explic…
coreference-resolutionCoreference ResolutionEvent Coreference ResolutionQuestion AnsweringRRRA: Resampling and Reranking through a Retriever Adapter
In dense retrieval, effective training hinges on selecting high quality hard negatives while avoiding false negatives. Recent methods apply heuristics based on positive document scores to identify hard negatives, improvi…
Bayesian Analysis of Dynamic Linear Topic Models
In dynamic topic modeling, the proportional contribution of a topic to a document depends on the temporal dynamics of that topic's overall prevalence in the corpus. We extend the Dynamic Topic Model of Blei and Lafferty …
Data AugmentationDynamic Topic ModelingTopic Models