Refining Raw Sentence Representations for Textual Entailment Recognition via Attention
In this paper we present the model used by the team Rivercorners for the 2017 RepEval shared task. First, our model separately encodes a pair of sentences into variable-length representations by using a bidirectional LSTM. Later, it creates fixed-length raw representations by means of simple aggregation functions, which are then refined using an attention mechanism. Finally it combines the refined representations of both sentences into a single vector to be used for classification. With this model we obtained test accuracies of 72.057% and 72.055% in the matched and mismatched evaluation tracks respectively, outperforming the LSTM baseline, and obtaining performances similar to a model that relies on shared information between sentences (ESIM). When using an ensemble both accuracies increased to 72.247% and 72.827% respectively.
Code (1)
Tasks
General ClassificationNatural Language InferenceSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Textual Entailment Recognition with Semantic Features from Empirical Text Representation
Textual entailment recognition is one of the basic natural language understanding(NLU) tasks. Understanding the meaning of sentences is a prerequisite before applying any natural language processing(NLP) techniques to au…
Natural Language InferenceNatural Language UnderstandingRTESentenceLogic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning
Due to their similarity-based learning objectives, pretrained sentence encoders often internalize stereotypical assumptions that reflect the social biases that exist within their training corpora. In this paper, we descr…
Natural Language InferenceSentencetext similarityHyperbolic sentence representations for solving Textual Entailment
Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual En…
Binary ClassificationNatural Language InferenceSentenceMultimodal Logical Inference System for Visual-Textual Entailment
A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as…
Automated Theorem ProvingNatural Language InferenceSemantic ParsingSentenceLearning Entailment-Based Sentence Embeddings from Natural Language Inference
Large datasets on natural language inference are a potentially valuable resource for inducing semantic representations of natural language sentences. But in many such models the embeddings computed by the sentence encod…
Inductive BiasNatural Language InferenceSentenceSentence Embeddings