paper-with-me

홈 › Papers

Seq2Edits: Sequence Transduction Using Span-level Edit Operations

2020-09-23 · EMNLP 2020 11 · Felix Stahlberg, Shankar Kumar

We propose Seq2Edits, an open-vocabulary approach to sequence editing for natural language processing (NLP) tasks with a high degree of overlap between input and output texts. In this approach, each sequence-to-sequence transduction is represented as a sequence of edit operations, where each operation either replaces an entire source span with target tokens or keeps it unchanged. We evaluate our method on five NLP tasks (text normalization, sentence fusion, sentence splitting & rephrasing, text simplification, and grammatical error correction) and report competitive results across the board. For grammatical error correction, our method speeds up inference by up to 5.2x compared to full sequence models because inference time depends on the number of edits rather than the number of target tokens. For text normalization, sentence fusion, and grammatical error correction, our approach improves explainability by associating each edit operation with a human-readable tag.

📄 PDF Abstract BibTeX arXiv:2009.11136

Code (1)

tensorflow/tensor2tensor/blob/master/tensor2tensor/models/research/transformer_seq2edits.py 공식 구현 tf

Tasks

Grammatical Error CorrectionSentenceSentence FusionTAGText NormalizationText Simplification

Methods 이 논문이 사용한 방법론

[LivE@PeRson]How do I talk to a real person at Expedia? How do I talk to a real person at Expedia? To speak with a live Expedia agent, call 1 (888) 829-0881 anytime. The customer support team is available 24/7 to help with…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Parallel Iterative Edit Models for Local Sequence Transduction

2019-10-07 · IJCNLP 2019 11 · Abhijeet Awasthi, Sunita Sarawagi, Rasna Goyal, Sabyasachi Ghosh 외

We present a Parallel Iterative Edit (PIE) model for the problem of local sequence transduction arising in tasks like Grammatical error correction (GEC). Recent approaches are based on the popular encoder-decoder (ED) mo…

DecoderGrammatical Error CorrectionOptical Character Recognition (OCR)

Reducing Sequence Length by Predicting Edit Operations with Large Language Models

2023-05-19 · Masahiro Kaneko, Naoaki Okazaki

Large Language Models (LLMs) have demonstrated remarkable performance in various tasks and gained significant attention. LLMs are also used for local sequence transduction tasks, including grammatical error correction (G…

Formality Style TransferGrammatical Error CorrectionStyle TransferText Simplification

SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pages

2023-05-30 · Philippe Laban, Jesse Vig, Wojciech Kryscinski, Shafiq Joty 외

Text simplification research has mostly focused on sentence-level simplification, even though many desirable edits - such as adding relevant background information or reordering content - may require document-level conte…

ArticlesSentenceText Simplification

arXivEdits: Understanding the Human Revision Process in Scientific Writing

2022-10-26 · Chao Jiang, Wei Xu, Samuel Stevens

Scientific publications are the primary means to communicate research discoveries, where the writing quality is of crucial importance. However, prior work studying the human editing process in this domain mainly focused …

intent-classificationIntent ClassificationSentence

EditPropBench: Measuring Factual Edit Propagation in Scientific Manuscripts

2026-05-03 · Garvin Kruthof arxiv

Local factual edits in scientific manuscripts often create non-local revision obligations. If a dataset changes from 215 to 80 documents, claims such as 'medium-scale' or 'a few hundred items' may also become stale, even…