Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference
Natural Language Inference (NLI), also known as Recognizing Textual Entailment (RTE), is one of the most important problems in natural language processing. It requires to infer the logical relationship between two given sentences. While current approaches mostly focus on the interaction architectures of the sentences, in this paper, we propose to transfer knowledge from some important discourse markers to augment the quality of the NLI model. We observe that people usually use some discourse markers such as "so" or "but" to represent the logical relationship between two sentences. These words potentially have deep connections with the meanings of the sentences, thus can be utilized to help improve the representations of them. Moreover, we use reinforcement learning to optimize a new objective function with a reward defined by the property of the NLI datasets to make full use of the labels information. Experiments show that our method achieves the state-of-the-art performance on several large-scale datasets.
Code (1)
Tasks
Natural Language Inferencereinforcement-learningReinforcement LearningReinforcement Learning (RL)RTESimilar Papers 제목 키워드 기반
Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relations
Discourse analysis is an important task because it models intrinsic semantic structures between sentences in a document. Discourse markers are natural representations of discourse in our daily language. One challenge is …
SentenceDo language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology
Markedness in natural language is often associated with non-literal meanings in discourse. Differential Object Marking (DOM) in Korean is one instance of this phenomenon, where post-positional markers are selected based …
ImplicaturesObjectA Generative Marker Enhanced End-to-End Framework for Argument Mining
Argument Mining (AM) involves identifying and extracting Argumentative Components (ACs) and their corresponding Argumentative Relations (ARs). Most of the prior works have broken down these tasks into multiple sub-tasks.…
Argument MiningDependency ParsingText GenerationTowards Using Machine Translation Techniques to Induce Multilingual Lexica of Discourse Markers
Discourse markers are universal linguistic events subject to language variation. Although an extensive literature has already reported language specific traits of these events, little has been said on their cross-languag…
Machine TranslationSentenceTranslationInducing Discourse Marker Inventories from Lexical Knowledge Graphs
Discourse marker inventories are important tools for the development of both discourse parsers and corpora with discourse annotations. In this paper we explore the potential of massively multilingual lexical knowledge gr…
Knowledge Graphs