Simple-QE: Better Automatic Quality Estimation for Text Simplification
Text simplification systems generate versions of texts that are easier to understand for a broader audience. The quality of simplified texts is generally estimated using metrics that compare to human references, which can be difficult to obtain. We propose Simple-QE, a BERT-based quality estimation (QE) model adapted from prior summarization QE work, and show that it correlates well with human quality judgments. Simple-QE does not require human references, which makes the model useful in a practical setting where users would need to be informed about the quality of generated simplifications. We also show that we can adapt this approach to accurately predict the complexity of human-written texts.
Code (0)
등록된 구현이 없습니다.
Tasks
Text SimplificationSimilar Papers 제목 키워드 기반
SpeechQE: Estimating the Quality of Direct Speech Translation
Recent advances in automatic quality estimation for machine translation have exclusively focused on written language, leaving the speech modality underexplored. In this work, we formulate the task of quality estimation f…
Machine TranslationTranslationSumQE: a BERT-based Summary Quality Estimation Model
We propose SumQE, a novel Quality Estimation model for summarization based on BERT. The model addresses linguistic quality aspects that are only indirectly captured by content-based approaches to summary evaluation, with…
modelSUM-QE: a BERT-based Summary Quality Estimation Model
We propose SUM-QE, a novel Quality Estimation model for summarization based on BERT. The model addresses linguistic quality aspects that are only indirectly captured by content-based approaches to summary evaluation, wit…
Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation
Inferring the probability distribution of sentences or word sequences is a key process in natural language processing. While word-level language models (LMs) have been widely adopted for computing the joint probabilities…
Language ModelingLanguage ModellingMultiple-choiceSentenceCEScore: Simple and Efficient Confidence Estimation Model for Evaluating Split and Rephrase
The split and rephrase (SR) task aims to divide a long, complex sentence into a set of shorter, simpler sentences that convey the same meaning. This challenging problem in NLP has gained increased attention recently beca…
SentenceSplit and Rephrase