Developmental Negation Processing in Transformer Language Models
Reasoning using negation is known to be difficult for transformer-based language models. While previous studies have used the tools of psycholinguistics to probe a transformer's ability to reason over negation, none have focused on the types of negation studied in developmental psychology. We explore how well transformers can process such categories of negation, by framing the problem as a natural language inference (NLI) task. We curate a set of diagnostic questions for our target categories from popular NLI datasets and evaluate how well a suite of models reason over them. We find that models perform consistently better only on certain categories, suggesting clear distinctions in how they are processed.
Code (1)
Tasks
DiagnosticNatural Language InferenceNegationSimilar Papers 제목 키워드 기반
An Analysis of Negation in Natural Language Understanding Corpora
This paper analyzes negation in eight popular corpora spanning six natural language understanding tasks. We show that these corpora have few negations compared to general-purpose English, and that the few negations in th…
Natural Language UnderstandingNegationThe Scope and Focus of Negation: A Complete Annotation Framework for Italian
In this paper we present a complete framework for the annotation of negation in Italian, which accounts for both negation scope and negation focus, and also for language-specific phenomena such as negative concord. In ou…
ArticlesDecision MakingNegationSentiment AnalysisAn Analysis of Natural Language Inference Benchmarks through the Lens of Negation
Negation is underrepresented in existing natural language inference benchmarks. Additionally, one can often ignore the few negations in existing benchmarks and still make the right inference judgments. In this paper, we …
Natural Language InferenceNegationCorpora Annotated with Negation: An Overview
Negation is a universal linguistic phenomenon with a great qualitative impact on natural language processing applications. The availability of corpora annotated with negation is essential to training negation processing …
NegationSemantic Role LabelingNegation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish.
Negation is a linguistic universal that poses difficulties for cognitive and computational processing. Despite many advances in text analytics, negation resolution remains an acute and continuously researched question in…
Machine TranslationNegationNegation DetectionNegation Scope Resolution+2