paper-with-me

홈 › Papers

Refining Raw Sentence Representations for Textual Entailment Recognition via Attention

2017-07-11 · WS 2017 9 · Jorge A. Balazs, Edison Marrese-Taylor, Pablo Loyola, Yutaka Matsuo

In this paper we present the model used by the team Rivercorners for the 2017 RepEval shared task. First, our model separately encodes a pair of sentences into variable-length representations by using a bidirectional LSTM. Later, it creates fixed-length raw representations by means of simple aggregation functions, which are then refined using an attention mechanism. Finally it combines the refined representations of both sentences into a single vector to be used for classification. With this model we obtained test accuracies of 72.057% and 72.055% in the matched and mismatched evaluation tracks respectively, outperforming the LSTM baseline, and obtaining performances similar to a model that relies on shared information between sentences (ESIM). When using an ensemble both accuracies increased to 72.247% and 72.827% respectively.

📄 PDF Abstract BibTeX arXiv:1707.03103

Code (1)

jabalazs/repeval_rivercorners 공식 구현 pytorch

Tasks

General ClassificationNatural Language InferenceSentence

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Textual Entailment Recognition with Semantic Features from Empirical Text Representation

2022-10-18 · Md Shajalal, Md Atabuzzaman, Maksuda Bilkis Baby, Md Rezaul Karim 외

Textual entailment recognition is one of the basic natural language understanding(NLU) tasks. Understanding the meaning of sentences is a prerequisite before applying any natural language processing(NLP) techniques to au…

Natural Language InferenceNatural Language UnderstandingRTESentence

Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning

2023-03-10 · Hongyin Luo, James Glass

Due to their similarity-based learning objectives, pretrained sentence encoders often internalize stereotypical assumptions that reflect the social biases that exist within their training corpora. In this paper, we descr…

Natural Language InferenceSentencetext similarity

Hyperbolic sentence representations for solving Textual Entailment

2024-06-15 · Igor Petrovski

Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual En…

Binary ClassificationNatural Language InferenceSentence

Multimodal Logical Inference System for Visual-Textual Entailment

2019-06-10 · ACL 2019 7 · Riko Suzuki, Hitomi Yanaka, Masashi Yoshikawa, Koji Mineshima 외

A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as…

Automated Theorem ProvingNatural Language InferenceSemantic ParsingSentence

Learning Entailment-Based Sentence Embeddings from Natural Language Inference

2019-09-25 · Rabeeh Karimi Mahabadi*, Florian Mai*, James Henderson

Large datasets on natural language inference are a potentially valuable resource for inducing semantic representations of natural language sentences. But in many such models the embeddings computed by the sentence encod…

Inductive BiasNatural Language InferenceSentenceSentence Embeddings