paper-with-me

홈 › Papers

Solving ESL Sentence Completion Questions via Pre-trained Neural Language Models

2021-07-15 · Qiongqiong Liu, Tianqiao Liu, Jiafu Zhao, Qiang Fang, Wenbiao Ding, Zhongqin Wu, Feng Xia, Jiliang Tang, Zitao Liu

Sentence completion (SC) questions present a sentence with one or more blanks that need to be filled in, three to five possible words or phrases as options. SC questions are widely used for students learning English as a Second Language (ESL) and building computational approaches to automatically solve such questions is beneficial to language learners. In this work, we propose a neural framework to solve SC questions in English examinations by utilizing pre-trained language models. We conduct extensive experiments on a real-world K-12 ESL SC question dataset and the results demonstrate the superiority of our model in terms of prediction accuracy. Furthermore, we run precision-recall trade-off analysis to discuss the practical issues when deploying it in real-life scenarios. To encourage reproducible results, we make our code publicly available at \url{https://github.com/AIED2021/ESL-SentenceCompletion}.

📄 PDF Abstract BibTeX arXiv:2107.07122

Code (1)

AIED2021/ESL-SentenceCompletion 공식 구현 pytorch

Tasks

SentenceSentence Completion

Similar Papers 제목 키워드 기반

SC-Ques: A Sentence Completion Question Dataset for English as a Second Language Learners

2022-06-24 · Qiongqiong Liu, Yaying Huang, Zitao Liu, Shuyan Huang 외

Sentence completion (SC) questions present a sentence with one or more blanks that need to be filled in, three to five possible words or phrases as options. SC questions are widely used for students learning English as a…

SentenceSentence Completion

HONEST: Measuring Hurtful Sentence Completion in Language Models

2021-06-01 · NAACL 2021 4 · Debora Nozza, Federico Bianchi, Dirk Hovy

Language models have revolutionized the field of NLP. However, language models capture and proliferate hurtful stereotypes, especially in text generation. Our results show that 4.3{\%} of the time, language models comple…

Hate Speech DetectionHurtful Sentence CompletionMultilingual NLPSentence+2

INSET: Sentence Infilling with INter-SEntential Transformer

2019-11-10 · ACL 2020 6 · Yichen Huang, Yizhe Zhang, Oussama Elachqar, Yu Cheng

Missing sentence generation (or sentence infilling) fosters a wide range of applications in natural language generation, such as document auto-completion and meeting note expansion. This task asks the model to generate i…

Natural Language UnderstandingSentenceText Generation

COINS: Dynamically Generating COntextualized Inference Rules for Narrative Story Completion

2021-06-04 · ACL 2021 5 · Debjit Paul, Anette Frank

Despite recent successes of large pre-trained language models in solving reasoning tasks, their inference capabilities remain opaque. We posit that such models can be made more interpretable by explicitly generating inte…

SentenceStory Completion

A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks

2020-10-07 · ICLR 2021 1 · Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora

Autoregressive language models, pretrained using large text corpora to do well on next word prediction, have been successful at solving many downstream tasks, even with zero-shot usage. However, there is little theoretic…

ClassificationGeneral ClassificationLanguage ModelingLanguage Modelling+4