Learning Interpretable Negation Rules via Weak Supervision at Document Level: A Reinforcement Learning Approach
Negation scope detection is widely performed as a supervised learning task which relies upon negation labels at word level. This suffers from two key drawbacks: (1) such granular annotations are costly and (2) highly subjective, since, due to the absence of explicit linguistic resolution rules, human annotators often disagree in the perceived negation scopes. To the best of our knowledge, our work presents the first approach that eliminates the need for world-level negation labels, replacing it instead with document-level sentiment annotations. For this, we present a novel strategy for learning fully interpretable negation rules via weak supervision: we apply reinforcement learning to find a policy that reconstructs negation rules from sentiment predictions at document level. Our experiments demonstrate that our approach for weak supervision can effectively learn negation rules. Furthermore, an out-of-sample evaluation via sentiment analysis reveals consistent improvements (of up to 4.66{\%}) over both a sentiment analysis with (i) no negation handling and (ii) the use of word-level annotations from humans. Moreover, the inferred negation rules are fully interpretable.
Code (0)
등록된 구현이 없습니다.
Tasks
NegationReinforcement LearningSentiment AnalysisSimilar Papers 제목 키워드 기반
Saying no but meaning yes: negation and sentiment analysis in Basque
In this work, we have analyzed the effects of negation on the semantic orientation in Basque. The analysis shows that negation markers can strengthen, weaken or have no effect on sentiment orientation of a word or a grou…
NegationSentiment AnalysisNevIR: Negation in Neural Information Retrieval
Negation is a common everyday phenomena and has been a consistent area of weakness for language models (LMs). Although the Information Retrieval (IR) community has adopted LMs as the backbone of modern IR architectures, …
Information RetrievalNegationRetrievalNeural Symbolic Logical Rule Learner for Interpretable Learning
Rule-based neural networks stand out for enabling interpretable classification by learning logical rules for both prediction and interpretation. However, existing models often lack flexibility due to the fixed model stru…
FormNegationAssessing the Quality of Human-Generated Summaries with Weakly Supervised Learning
This paper explores how to automatically measure the quality of human-generated summaries, based on a Norwegian corpus of real estate condition reports and their corresponding summaries. The proposed approach proceeds in…
Weakly-supervised LearningWALNUT: A Benchmark on Semi-weakly Supervised Learning for Natural Language Understanding
Building machine learning models for natural language understanding (NLU) tasks relies heavily on labeled data. Weak supervision has been proven valuable when large amount of labeled data is unavailable or expensive to o…
Natural Language UnderstandingWeakly-supervised Learning