Mining Knowledge for Natural Language Inference from Wikipedia Categories
Accurate lexical entailment (LE) and natural language inference (NLI) often require large quantities of costly annotations. To alleviate the need for labeled data, we introduce WikiNLI: a resource for improving model performance on NLI and LE tasks. It contains 428,899 pairs of phrases constructed from naturally annotated category hierarchies in Wikipedia. We show that we can improve strong baselines such as BERT and RoBERTa by pretraining them on WikiNLI and transferring the models on downstream tasks. We conduct systematic comparisons with phrases extracted from other knowledge bases such as WordNet and Wikidata to find that pretraining on WikiNLI gives the best performance. In addition, we construct WikiNLI in other languages, and show that pretraining on them improves performance on NLI tasks of corresponding languages.
Code (1)
Tasks
Lexical EntailmentNatural Language InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Wikipedia in the Era of LLMs: Evolution and Risks
In this paper, we present a thorough analysis of the impact of Large Language Models (LLMs) on Wikipedia, examining the evolution of Wikipedia through existing data and using simulations to explore potential risks. We be…
ArticlesMachine TranslationRAGRetrieval-augmented Generation+1An Assessment of Language Identification Methods on Tweets and Wikipedia Articles
Language identification is the task of determining the language which a given text is written. This task is important for Natural Language Processing and Information Retrieval activities. Two popular approaches for langu…
ArticlesInformation RetrievalLanguage IdentificationRetrievalLink Prediction for Wikipedia Articles as a Natural Language Inference Task
Link prediction task is vital to automatically understanding the structure of large knowledge bases. In this paper, we present our system to solve this task at the Data Science and Advanced Analytics 2023 Competition "Ef…
ArticlesLink PredictionNatural Language InferencePrediction+2Cross-lingual Name Tagging and Linking for 282 Languages
The ambitious goal of this work is to develop a cross-lingual name tagging and linking framework for 282 languages that exist in Wikipedia. Given a document in any of these languages, our framework is able to identify na…
TranslationWord TranslationCultural Topic Modelling over Novel Wikipedia Corpora for South-Slavic Languages
There is a shortage of high-quality corpora for South-Slavic languages. Such corpora are useful to computer scientists and researchers in social sciences and humanities alike, focusing on numerous linguistic, content ana…
Cultural Vocal Bursts Intensity Prediction