paper-with-me

홈 › Papers

LSBert: A Simple Framework for Lexical Simplification

2020-06-25 · Jipeng Qiang, Yun Li, Yi Zhu, Yunhao Yuan, Xindong Wu

Lexical simplification (LS) aims to replace complex words in a given sentence with their simpler alternatives of equivalent meaning, to simplify the sentence. Recently unsupervised lexical simplification approaches only rely on the complex word itself regardless of the given sentence to generate candidate substitutions, which will inevitably produce a large number of spurious candidates. In this paper, we propose a lexical simplification framework LSBert based on pretrained representation model Bert, that is capable of (1) making use of the wider context when both detecting the words in need of simplification and generating substitue candidates, and (2) taking five high-quality features into account for ranking candidates, including Bert prediction order, Bert-based language model, and the paraphrase database PPDB, in addition to the word frequency and word similarity commonly used in other LS methods. We show that our system outputs lexical simplifications that are grammatically correct and semantically appropriate, and obtains obvious improvement compared with these baselines, outperforming the state-of-the-art by 29.8 Accuracy points on three well-known benchmarks.

📄 PDF Abstract BibTeX arXiv:2006.14939

Code (1)

qiang2100/BERT-LS pytorch

Tasks

Language ModelingLanguage ModellingLexical SimplificationSentenceWord Similarity

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders

2022-12-19 · Xiaofei Li, Daniel Wiechmann, Yu Qiao, Elma Kerz

In this paper we present our contribution to the TSAR-2022 Shared Task on Lexical Simplification of the EMNLP 2022 Workshop on Text Simplification, Accessibility, and Readability. Our approach builds on and extends the u…

Language ModelingLanguage ModellingLexical SimplificationNatural Language Inference+3

Controllable Lexical Simplification for English

2023-02-06 · Kim Cheng SHEANG, Daniel Ferrés, Horacio Saggion

Fine-tuning Transformer-based approaches have recently shown exciting results on sentence simplification task. However, so far, no research has applied similar approaches to the Lexical Simplification (LS) task. In this …

Lexical SimplificationSentence

Multilingual Controllable Transformer-Based Lexical Simplification

2023-07-05 · Kim Cheng SHEANG, Horacio Saggion

Text is by far the most ubiquitous source of knowledge and information and should be made easily accessible to as many people as possible; however, texts often contain complex words that hinder reading comprehension and …

Lexical SimplificationReading Comprehension

Simplification Using Paraphrases and Context-Based Lexical Substitution

2018-06-01 · NAACL 2018 6 · Reno Kriz, Eleni Miltsakaki, Marianna Apidianaki, Chris Callison-Burch

Lexical simplification involves identifying complex words or phrases that need to be simplified, and recommending simpler meaning-preserving substitutes that can be more easily understood. We propose a complex word ident…

Complex Word IdentificationLexical SimplificationText Simplification

RALS: Resources and Baselines for Romanian Automatic Lexical Simplification

2026-07-22 · Fabian Anghel, Petru Theodor Cristea, Claudiu Creanga, Sergiu Nisioi arxiv

We introduce the first dataset that jointly covers both lexical complexity prediction (LCP) annotations and lexical simplification (LS) for Romanian, along with a comparison of lexical simplification approaches. We propo…

Text Simplification