Language Models for Cloze Task Answer Generation in Russian
Linguistics predictability is the degree of confidence in which language unit (word, part of speech, etc.) will be the next in the sequence. Experiments have shown that the correct prediction simplifies the perception of a language unit and its integration into the context. As a result of an incorrect prediction, language processing slows down. Currently, to get a measure of the language unit predictability, a neurolinguistic experiment known as a cloze task has to be conducted on a large number of participants. Cloze tasks are resource-consuming and are criticized by some researchers as an insufficiently valid measure of predictability. In this paper, we compare different language models that attempt to simulate human respondents{'} performance on the cloze task. Using a language model to create cloze task simulations would require significantly less time and conduct studies related to linguistic predictability.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer GenerationLanguage ModelingLanguage ModellingvalidSimilar Papers 제목 키워드 기반
A System for Generating Cloze Test Items from Russian-Language Text
Clozer: Adaptable Data Augmentation for Cloze-style Reading Comprehension
Task-adaptive pre-training (TAPT) alleviates the lack of labelled data and provides performance lift by adapting unlabelled data to downstream task. Unfortunately, existing adaptations mainly involve deterministic rules …
Data AugmentationMachine Reading ComprehensionMultiple-choiceReading ComprehensionClozer”:" Adaptable Data Augmentation for Cloze-style Reading Comprehension
Task-adaptive pre-training (TAPT) alleviates the lack of labelled data and provides performance lift by adapting unlabelled data to downstream task. Unfortunately, existing adaptations mainly involve deterministic rules …
Data AugmentationMachine Reading ComprehensionMultiple-choiceReading ComprehensionImproving Factual Error Correction for Abstractive Summarization via Data Distillation and Conditional-generation Cloze
Improving factual consistency in abstractive summarization has been a focus of current research. One promising approach is the post-editing method. However, previous works have yet to make sufficient use of factual facto…
Abstractive Text SummarizationDaNetQA: a yes/no Question Answering Dataset for the Russian Language
DaNetQA, a new question-answering corpus, follows (Clark et. al, 2019) design: it comprises natural yes/no questions. Each question is paired with a paragraph from Wikipedia and an answer, derived from the paragraph. The…
Question AnsweringSentenceTransfer LearningTranslation