paper-with-me

Papers

SimpLex: a lexical text simplification architecture

2023-04-14 · Ciprian-Octavian Truică, Andrei-Ionut Stan, Elena-Simona Apostol

Text simplification (TS) is the process of generating easy-to-understand sentences from a given sentence or piece of text. The aim of TS is to reduce both the lexical (which refers to vocabulary complexity and meaning) and syntactic (which refers to the sentence structure) complexity of a given text or sentence without the loss of meaning or nuance. In this paper, we present \textsc{SimpLex}, a novel simplification architecture for generating simplified English sentences. To generate a simplified sentence, the proposed architecture uses either word embeddings (i.e., Word2Vec) and perplexity, or sentence transformers (i.e., BERT, RoBERTa, and GPT2) and cosine similarity. The solution is incorporated into a user-friendly and simple-to-use software. We evaluate our system using two metrics, i.e., SARI, and Perplexity Decrease. Experimentally, we observe that the transformer models outperform the other models in terms of the SARI score. However, in terms of Perplexity, the Word-Embeddings-based models achieve the biggest decrease. Thus, the main contributions of this paper are: (1) We propose a new Word Embedding and Transformer based algorithm for text simplification; (2) We design \textsc{SimpLex} -- a modular novel text simplification system -- that can provide a baseline for further research; and (3) We perform an in-depth analysis of our solution and compare our results with two state-of-the-art models, i.e., LightLS [19] and NTS-w2v [44]. We also make the code publicly available online.

📄 PDF Abstract BibTeX arXiv:2304.07002

Code (1)

elena-apostol/simplex 공식 구현

Tasks

SentenceText SimplificationWord Embeddings

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

SIMPLEX-PB 2.0: A Reliable Dataset for Lexical Simplification in Brazilian Portuguese

2020-07-01 · WS 2020 7 · Nathan Hartmann, Gustavo Henrique Paetzold, S Alu{\'\i}sio, ra

Most research on Lexical Simplification (LS) addresses non-native speakers of English, since they are numerous and easy to recruit. This makes it difficult to create LS solutions for other languages and target audiences.…

Lexical Simplification

Recursive Context-Aware Lexical Simplification

2019-11-01 · IJCNLP 2019 11 · Sian Gooding, Ekaterina Kochmar

This paper presents a novel architecture for recursive context-aware lexical simplification, REC-LS, that is capable of (1) making use of the wider context when detecting the words in need of simplification and suggestin…

Lexical Simplification

An Adaptable Lexical Simplification Architecture for Major Ibero-Romance Languages

2017-09-01 · WS 2017 9 · Daniel Ferr{\'e}s, Horacio Saggion, Xavier G{\'o}mez Guinovart

Lexical Simplification is the task of reducing the lexical complexity of textual documents by replacing difficult words with easier to read (or understand) expressions while preserving the original meaning. The developme…

Lexical SimplificationText Simplification

Lexical Simplification Benchmarks for English, Portuguese, and Spanish

2022-09-12 · Sanja Stajner, Daniel Ferres, Matthew Shardlow, Kai North 외

Even in highly-developed countries, as many as 15-30\% of the population can only understand texts written using a basic vocabulary. Their understanding of everyday texts is limited, which prevents them from taking an ac…

Lexical Simplification

Coreference-Based Text Simplification

2020-05-01 · LREC 2020 5 · Rodrigo Wilkens, Bruno Oberle, Amalia Todirascu

Text simplification aims at adapting documents to make them easier to read by a given audience. Usually, simplification systems consider only lexical and syntactic levels, and, moreover, are often evaluated at the senten…

coreference-resolutionCoreference ResolutionSentenceText Simplification