Learning the Impact and Behavior of Syntactic Structure: A Case Study in Semantic Textual Similarity
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningSemantic Textual SimilarityWord AlignmentSimilar Papers 제목 키워드 기반
Lexicosyntactic Inference in Neural Models
We investigate neural models' ability to capture lexicosyntactic inferences: inferences triggered by the interaction of lexical and syntactic information. We take the task of event factuality prediction as a case study a…
PredictionLexicosyntactic Inference in Neural Models
We investigate neural models' ability to capture "lexicosyntactic inferences": inferences triggered by the interaction of lexical and syntactic information. We take the task of event factuality prediction as a case study…
PredictionSudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
Most interpretability research in NLP focuses on understanding the behavior and features of a fully trained model. However, certain insights into model behavior may only be accessible by observing the trajectory of the t…
Representation of Constituents in Neural Language Models: Coordination Phrase as a Case Study
Neural language models have achieved state-of-the-art performances on many NLP tasks, and recently have been shown to learn a number of hierarchically-sensitive syntactic dependencies between individual words. However, e…
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Targeted syntactic evaluations have demonstrated the ability of language models to perform subject-verb agreement given difficult contexts. To elucidate the mechanisms by which the models accomplish this behavior, this s…
Sentence