Local String Transduction as Sequence Labeling
We show that the general problem of string transduction can be reduced to the problem of sequence labeling. While character deletion and insertions are allowed in string transduction, they do not exist in sequence labeling. We show how to overcome this difference. Our approach can be used with any sequence labeling algorithm and it works best for problems in which string transduction imposes a strong notion of locality (no long range dependencies). We experiment with spelling correction for social media, OCR correction, and morphological inflection, and we see that it behaves better than seq2seq models and yields state-of-the-art results in several cases.
Code (0)
등록된 구현이 없습니다.
Tasks
LemmatizationMachine TranslationMorphological InflectionNamed Entity Recognition (NER)Optical Character Recognition (OCR)Part-Of-Speech TaggingSemantic Role LabelingSpelling CorrectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exact Hard Monotonic Attention for Character-Level Transduction
Many common character-level, string-to string transduction tasks, e.g., grapheme-tophoneme conversion and morphological inflection, consist almost exclusively of monotonic transductions. However, neural sequence-to seque…
Hard AttentionInductive BiasMorphological InflectionParallel Iterative Edit Models for Local Sequence Transduction
We present a Parallel Iterative Edit (PIE) model for the problem of local sequence transduction arising in tasks like Grammatical error correction (GEC). Recent approaches are based on the popular encoder-decoder (ED) mo…
DecoderGrammatical Error CorrectionOptical Character Recognition (OCR)Hard Non-Monotonic Attention for Character-Level Transduction
Character-level string-to-string transduction is an important component of various NLP tasks. The goal is to map an input string to an output string, where the strings may be of different lengths and have characters take…
Hard AttentionImage CaptioningString Transduction with Target Language Models and Insertion Handling
Many character-level tasks can be framed as sequence-to-sequence transduction, where the target is a word from a natural language. We show that leveraging target language models derived from unannotated target corpora, c…
Learning Transductions and Alignments with RNN Seq2seq Models
The paper studies the capabilities of Recurrent-Neural-Network sequence to sequence (RNN seq2seq) models in learning four transduction tasks: identity, reversal, total reduplication, and quadratic copying. These transduc…
Out-of-Distribution Generalization