paper-with-me

Papers

SciNLI: A Corpus for Natural Language Inference on Scientific Text

2022-03-13 · ACL 2022 5 · Mobashir Sadat, Cornelia Caragea

Existing Natural Language Inference (NLI) datasets, while being instrumental in the advancement of Natural Language Understanding (NLU) research, are not related to scientific text. In this paper, we introduce SciNLI, a large dataset for NLI that captures the formality in scientific text and contains 107,412 sentence pairs extracted from scholarly papers on NLP and computational linguistics. Given that the text used in scientific literature differs vastly from the text used in everyday language both in terms of vocabulary and sentence structure, our dataset is well suited to serve as a benchmark for the evaluation of scientific NLU models. Our experiments show that SciNLI is harder to classify than the existing NLI datasets. Our best performing model with XLNet achieves a Macro F1 score of only 78.18% and an accuracy of 78.23% showing that there is substantial room for improvement.

📄 PDF Abstract BibTeX arXiv:2203.06728

Code (1)

msadat3/scinli 공식 구현 pytorch

Tasks

Natural Language InferenceNatural Language UnderstandingSentence

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
SentencePiece 설명 없음

Similar Papers 제목 키워드 기반

MSciNLI: A Diverse Benchmark for Scientific Natural Language Inference

2024-04-11 · Mobashir Sadat, Cornelia Caragea

The task of scientific Natural Language Inference (NLI) involves predicting the semantic relation between two sentences extracted from research articles. This task was recently proposed along with a new dataset called Sc…

ArticlesDiversityNatural Language InferenceSentence+1

Co-training for Low Resource Scientific Natural Language Inference

2024-06-20 · Mobashir Sadat, Cornelia Caragea

Scientific Natural Language Inference (NLI) is the task of predicting the semantic relation between a pair of sentences extracted from research articles. The automatic annotation method based on distant supervision for t…

ArticlesNatural Language Inference

CSL: A Large-scale Chinese Scientific Literature Dataset

2022-09-12 · COLING 2022 10 · Yudong Li, Yuqing Zhang, Zhe Zhao, Linlin Shen 외

Scientific literature serves as a high-quality corpus, supporting a lot of Natural Language Processing (NLP) research. However, existing datasets are centered around the English language, which restricts the development …

text-classificationText Classification

Scientific Explanation and Natural Language: A Unified Epistemological-Linguistic Perspective for Explainable AI

2022-05-03 · Marco Valentino, André Freitas

A fundamental research goal for Explainable AI (XAI) is to build models that are capable of reasoning through the generation of natural language explanations. However, the methodologies to design and evaluate explanation…

Explainable Artificial Intelligence (XAI)Philosophy

A Multi-Layered Annotated Corpus of Scientific Papers

2016-05-01 · LREC 2016 5 · Beatriz Fisas, Francesco Ronzano, Horacio Saggion

Scientific literature records the research process with a standardized structure and provides the clues to track the progress in a scientific field. Understanding its internal structure and content is of paramount import…

Sentence