paper-with-me

홈 › Papers

e-SNLI: Natural Language Inference with Natural Language Explanations

2018-12-04 · NeurIPS 2018 12 · Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, Phil Blunsom

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we extend the Stanford Natural Language Inference dataset with an additional layer of human-annotated natural language explanations of the entailment relations. We further implement models that incorporate these explanations into their training process and output them at test time. We show how our corpus of explanations, which we call e-SNLI, can be used for various goals, such as obtaining full sentence justifications of a model's decisions, improving universal sentence representations and transferring to out-of-domain NLI datasets. Our dataset thus opens up a range of research directions for using natural language explanations, both for improving models and for asserting their trust.

📄 PDF Abstract BibTeX arXiv:1812.01193

Code (2)

OanaMariaCamburu/e-SNLI pytorch
qtli/eib pytorch

Tasks

Natural Language InferenceSentence

Similar Papers 제목 키워드 기반

Social Bias in Elicited Natural Language Inferences

2017-04-01 · WS 2017 4 · Rachel Rudinger, Ch May, ler, Benjamin Van Durme

We analyze the Stanford Natural Language Inference (SNLI) corpus in an investigation of bias and stereotyping in NLP data. The SNLI human-elicitation protocol makes it prone to amplifying bias and stereotypical associati…

Language ModelingLanguage ModellingNatural Language InferenceWord Embeddings

JamPatoisNLI: A Jamaican Patois Natural Language Inference Dataset

2022-12-07 · Ruth-Ann Armstrong, John Hewitt, Christopher Manning

JamPatoisNLI provides the first dataset for natural language inference in a creole language, Jamaican Patois. Many of the most-spoken low-resource languages are creoles. These languages commonly have a lexicon derived fr…

Cross-Lingual TransferFew-Shot LearningNatural Language Inference

An Exploration of Dropout with RNNs for Natural Language Inference

2018-10-22 · Amit Gajbhiye, Sardar Jaf, Noura Al Moubayed, A. Stephen McGough 외

Dropout is a crucial regularization technique for the Recurrent Neural Network (RNN) models of Natural Language Inference (NLI). However, dropout has not been evaluated for the effectiveness at different layers and dropo…

Natural Language Inference

Visual Entailment Task for Visually-Grounded Language Learning

2018-11-26 · Ning Xie, Farley Lai, Derek Doran, Asim Kadav

We introduce a new inference task - Visual Entailment (VE) - which differs from traditional Textual Entailment (TE) tasks whereby a premise is defined by an image, rather than a natural language sentence as in TE tasks. …

Grounded language learningNatural Language InferenceQuestion AnsweringSentence+3

Reverse-engineering NLI: A study of the meta-inferential properties of Natural Language Inference

2026-01-08 · Rasmus Blanck, Bill Noble, Stergios Chatzikyriakidis arxiv

Natural Language Inference (NLI) has been an important task for evaluating language models for Natural Language Understanding, but the logical properties of the task are poorly understood and often mischaracterized. Unde…

Natural Language UnderstandingNatural Language Inference