Implicit causality in GPT-2: a case study
This case study investigates the extent to which a language model (GPT-2) is able to capture native speakers' intuitions about implicit causality in a sentence completion task. We first reproduce earlier results (showing lower surprisal values for pronouns that are congruent with either the subject or object, depending on which one corresponds to the implicit causality bias of the verb), and then examine the effects of gender and verb frequency on model performance. Our second study examines the reasoning ability of GPT-2: is the model able to produce more sensible motivations for why the subject VERBed the object if the verbs have stronger causality biases? We also developed a methodology to avoid human raters being biased by obscenities and disfluencies generated by the model.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingObjectSentenceSentence CompletionSimilar Papers 제목 키워드 기반
John praised Mary because he? Implicit Causality Bias and Its Interaction with Explicit Cues in LMs
Some interpersonal verbs can implicitly attribute causality to either their subject or their object and are therefore said to carry an implicit causality (IC) bias. Through this bias, causal links can be inferred from a …
AttributeSentenceUncertainty promotes neuroreductionism: A behavioral online study on folk psychological causal inference from neuroimaging data
Introduction. Increased efforts in neuroscience try to understand mental disorders as brain disorders. In the present study we investigate how common a neuroreductionist inclination is among highly educated people. In pa…
AttributeCausal InferenceCAUSE: Learning Granger Causality from Event Sequences using Attribution Methods
We study the problem of learning Granger causality between event types from asynchronous, interdependent, multi-type event sequences. Existing work suffers from either limited model flexibility or poor model explainabili…
MotifDisco: Motif Causal Discovery For Time Series Motifs
Many time series, particularly health data streams, can be best understood as a sequence of phenomenon or events, which we call motifs. A time series motif is a short trace segment which may implicitly capture an underly…
Anomaly DetectionCausal DiscoveryGraph Neural NetworkLink Prediction+1Causality-Inspired Taxonomy for Explainable Artificial Intelligence
As two sides of the same coin, causality and explainable artificial intelligence (xAI) were initially proposed and developed with different goals. However, the latter can only be complete when seen through the lens of th…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)