paper-with-me

Papers

Controllable Lexical Simplification for English

2023-02-06 · Kim Cheng SHEANG, Daniel Ferrés, Horacio Saggion

Fine-tuning Transformer-based approaches have recently shown exciting results on sentence simplification task. However, so far, no research has applied similar approaches to the Lexical Simplification (LS) task. In this paper, we present ConLS, a Controllable Lexical Simplification system fine-tuned with T5 (a Transformer-based model pre-trained with a BERT-style approach and several other tasks). The evaluation results on three datasets (LexMTurk, BenchLS, and NNSeval) have shown that our model performs comparable to LSBert (the current state-of-the-art) and even outperforms it in some cases. We also conducted a detailed comparison on the effectiveness of control tokens to give a clear view of how each token contributes to the model.

📄 PDF Abstract BibTeX arXiv:2302.02900

Code (1)

kimchengsheang/conls 공식 구현 pytorch

Tasks

Lexical SimplificationSentence

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases

2020-05-01 · LREC 2022 6 · Louis Martin, Angela Fan, Éric de la Clergerie, Antoine Bordes 외

Progress in sentence simplification has been hindered by a lack of labeled parallel simplification data, particularly in languages other than English. We introduce MUSS, a Multilingual Unsupervised Sentence Simplificatio…

Parallel Corpus MiningSentenceText Simplification

Findings of the TSAR-2022 Shared Task on Multilingual Lexical Simplification

2023-02-06 · Horacio Saggion, Sanja Štajner, Daniel Ferrés, Kim Cheng SHEANG 외

We report findings of the TSAR-2022 shared task on multilingual lexical simplification, organized as part of the Workshop on Text Simplification, Accessibility, and Readability TSAR-2022 held in conjunction with EMNLP 20…

Lexical SimplificationText Simplification

Lexical Simplification Benchmarks for English, Portuguese, and Spanish

2022-09-12 · Sanja Stajner, Daniel Ferres, Matthew Shardlow, Kai North 외

Even in highly-developed countries, as many as 15-30\% of the population can only understand texts written using a basic vocabulary. Their understanding of everyday texts is limited, which prevents them from taking an ac…

Lexical Simplification

Controllable Sentence Simplification: Employing Syntactic and Lexical Constraints

2019-10-10 · Jonathan Mallinson, Mirella Lapata

Sentence simplification aims to make sentences easier to read and understand. Recent approaches have shown promising results with sequence-to-sequence models which have been developed assuming homogeneous target audience…

Sentence

Understanding the Lexical Simplification Needs of Non-Native Speakers of English

2016-12-01 · COLING 2016 12 · Gustavo Paetzold, Lucia Specia

We report three user studies in which the Lexical Simplification needs of non-native English speakers are investigated. Our analyses feature valuable new insight on the relationship between the non-natives{'} notion of c…

Complex Word IdentificationLexical SimplificationMisconceptionsText Simplification