Character Sequence-to-Sequence Model with Global Attention for Universal Morphological Reinflection
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationQuestion AnsweringSimilar Papers 제목 키워드 기반
Universal Approximation with Softmax Attention
We prove that with linear transformations, both (i) two-layer self-attention and (ii) one-layer self-attention followed by a softmax function are universal approximators for continuous sequence-to-sequence functions on c…
Big Bird: Transformers for Longer Sequences
Transformers-based models, such as BERT, have been one of the most successful deep learning models for NLP. Unfortunately, one of their core limitations is the quadratic dependency (mainly in terms of memory) on the sequ…
Linguistic AcceptabilityNatural Language InferenceQuestion AnsweringSemantic Textual Similarity+2Are Transformers universal approximators of sequence-to-sequence functions?
Despite the widespread adoption of Transformer models for NLP tasks, the expressive power of these models is not well-understood. In this paper, we establish that Transformer models are universal approximators of continu…
Sequence-To-Sequence Domain Adaptation Network for Robust Text Image Recognition
Domain adaptation has shown promising advances for alleviating domain shift problem. However, recent visual domain adaptation works usually focus on non-sequential object recognition with a global coarse alignment, which…
DecoderDomain AdaptationObject RecognitionPrompting a Pretrained Transformer Can Be a Universal Approximator
Despite the widespread adoption of prompting, prompt tuning and prefix-tuning of transformer models, our theoretical understanding of these fine-tuning methods remains limited. A key question is whether one can arbitrari…