paper-with-me

Papers

A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference Corpus

2024-05-20 · Eduard Poesina, Cornelia Caragea, Radu Tudor Ionescu

Natural language inference (NLI), the task of recognizing the entailment relationship in sentence pairs, is an actively studied topic serving as a proxy for natural language understanding. Despite the relevance of the task in building conversational agents and improving text classification, machine translation and other NLP tasks, to the best of our knowledge, there is no publicly available NLI corpus for the Romanian language. To this end, we introduce the first Romanian NLI corpus (RoNLI) comprising 58K training sentence pairs, which are obtained via distant supervision, and 6K validation and test sentence pairs, which are manually annotated with the correct labels. We conduct experiments with multiple machine learning methods based on distant learning, ranging from shallow models based on word embeddings to transformer-based neural networks, to establish a set of competitive baselines. Furthermore, we improve on the best model by employing a new curriculum learning strategy based on data cartography. Our dataset and code to reproduce the baselines are available at https://github.com/Eduard6421/RONLI.

📄 PDF Abstract BibTeX arXiv:2405.11877

Code (1)

eduard6421/ronli 공식 구현 pytorch

Tasks

Machine TranslationNatural Language InferenceNatural Language UnderstandingSentencetext-classificationText ClassificationWord Embeddings

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Harnessing Dataset Cartography for Improved Compositional Generalization in Transformers

2023-10-18 · Osman Batur İnce, Tanin Zeraati, Semih Yagcioglu, Yadollah Yaghoobzadeh 외

Neural networks have revolutionized language modeling and excelled in various downstream tasks. However, the extent to which these models achieve compositional generalization comparable to human cognitive abilities remai…

Language ModelingLanguage Modelling

RoMathExam: A Longitudinal Dataset of Romanian Math Exams (1895-2025) with a Seven-Decade Core (1957-2025)

2026-03-28 · Luca-Ncolae Cuclea, Sabin-Codrut Badea, Adrian-Marius Dumitran arxiv

AI in Education research increasingly relies on authentic, curriculum-grounded assessment data, yet large, well-structured exam corpora remain scarce for many languages and educational systems. We introduce RoMathExam, a…

Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation

2023-09-06 · Keyu Chen, Di Zhuang, Mingchen Li, J. Morris Chang

Neural Machine Translation (NMT) models have become successful, but their performance remains poor when translating on new domains with a limited number of data. In this paper, we present a novel approach Epi-Curriculum …

DecoderDomain AdaptationMachine TranslationNMT+1

Artificial Intelligence Studies in Cartography: A Review and Synthesis of Methods, Applications, and Ethics

2023-12-13 · Yuhao Kang, Song Gao, Robert E. Roth

The past decade has witnessed the rapid development of geospatial artificial intelligence (GeoAI) primarily due to the ground-breaking achievements in deep learning and machine learning. A growing number of scholars from…

Ethics

Narrative Cartography with Knowledge Graphs

2021-12-02 · Gengchen Mai, Weiming Huang, Ling Cai, Rui Zhu 외

Narrative cartography is a discipline which studies the interwoven nature of stories and maps. However, conventional geovisualization techniques of narratives often encounter several prominent challenges, including the d…

Knowledge Graphs