Predicting Discourse Structure using Distant Supervision from Sentiment
Discourse parsing could not yet take full advantage of the neural NLP revolution, mostly due to the lack of annotated datasets. We propose a novel approach that uses distant supervision on an auxiliary task (sentiment classification), to generate abundant data for RST-style discourse structure prediction. Our approach combines a neural variant of multiple-instance learning, using document-level supervision, with an optimal CKY-style tree generation algorithm. In a series of experiments, we train a discourse parser (for only structure prediction) on our automatically generated dataset and compare it with parsers trained on human-annotated corpora (news domain RST-DT and Instructional domain). Results indicate that while our parser does not yet match the performance of a parser trained and tested on the same dataset (intra-domain), it does perform remarkably well on the much more difficult and arguably more useful task of inter-domain discourse structure prediction, where the parser is trained on one domain and tested/applied on another one.
Code (0)
등록된 구현이 없습니다.
Tasks
Discourse ParsingMultiple Instance LearningPredictionSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
Predicting Above-Sentence Discourse Structure using Distant Supervision from Topic Segmentation
RST-style discourse parsing plays a vital role in many NLP tasks, revealing the underlying semantic/pragmatic structure of potentially complex and diverse documents. Despite its importance, one of the most prevailing lim…
Discourse ParsingSentenceSentiment AnalysisMEGA RST Discourse Treebanks with Structure and Nuclearity from Scalable Distant Sentiment Supervision
The lack of large and diverse discourse treebanks hinders the application of data-driven approaches, such as deep-learning, to RST-style discourse parsing. In this work, we present a novel scalable methodology to automat…
Discourse ParsingLarge Discourse Treebanks from Scalable Distant Supervision
Discourse parsing is an essential upstream task in Natural Language Processing with strong implications for many real-world applications. Despite its widely recognized role, most recent discourse parsers (and consequentl…
Discourse ParsingSentiment AnalysisTopic-driven Distant Supervision Framework for Macro-level Discourse Parsing
Discourse parsing, the task of analyzing the internal rhetorical structure of texts, is a challenging problem in natural language processing. Despite the recent advances in neural models, the lack of large-scale, high-qu…
Discourse ParsingTransfer LearningTopicThunder at SemEval-2017 Task 4: Sentiment Classification Using a Convolutional Neural Network with Distant Supervision
In this paper, we propose a classifier for predicting topic-specific sentiments of English Twitter messages. Our method is based on a 2-layer CNN.With a distant supervised phase we leverage a large amount of weakly-label…
General ClassificationSentiment AnalysisSentiment ClassificationWord Embeddings