paper-with-me

Papers

Duplex Sequence-to-Sequence Learning for Reversible Machine Translation

2021-05-07 · NeurIPS 2021 12 · Zaixiang Zheng, Hao Zhou, ShuJian Huang, Jiajun Chen, Jingjing Xu, Lei LI

Sequence-to-sequence learning naturally has two directions. How to effectively utilize supervision signals from both directions? Existing approaches either require two separate models, or a multitask-learned model but with inferior performance. In this paper, we propose REDER (Reversible Duplex Transformer), a parameter-efficient model and apply it to machine translation. Either end of REDER can simultaneously input and output a distinct language. Thus REDER enables reversible machine translation by simply flipping the input and output ends. Experiments verify that REDER achieves the first success of reversible machine translation, which helps outperform its multitask-trained baselines by up to 1.3 BLEU.

📄 PDF Abstract BibTeX arXiv:2105.03458

Code (1)

zhengzx-nlp/reder 공식 구현 pytorch

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Duplex Diffusion Models Improve Speech-to-Speech Translation

2023-05-22 · Xianchao Wu

Speech-to-speech translation is a typical sequence-to-sequence learning task that naturally has two directions. How to effectively leverage bidirectional supervision signals to produce high-fidelity audio for both direct…

Speech-to-Speech TranslationTranslation

Hamiltonian dynamics and distributed chaos in DNA

2018-02-14 · A. Bershadskii

It is shown that distributed chaos, generated by Hamiltonian DNA dynamics with spontaneously broken time translational symmetry, imprints itself on the DNA sequence of Arabidopsis thaliana (a model plant for genetic sequ…

Laotian Bat Sarbecovirus BANAL-236 Uses ACE2 to Infect Cells by an Unknown Mechanism

2021-12-12 · Steven Carl Quay

A manuscript identified bat sarbecoviruses with high sequence homology to SARS-CoV-2 found in caves in Laos that can directly infect human cells via the human ACE2 receptor (Coronaviruses with a SARS-CoV-2-like receptor …

Deterministic Reversible Data Augmentation for Neural Machine Translation

2024-06-04 · Jiashu Yao, Heyan Huang, Zeming Liu, Yuhang Guo

Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and rand…

Data AugmentationMachine TranslationTranslation

Forest-Based Neural Machine Translation

2018-07-01 · ACL 2018 7 · Chunpeng Ma, Akihiro Tamura, Masao Utiyama, Tiejun Zhao 외

Tree-based neural machine translation (NMT) approaches, although achieved impressive performance, suffer from a major drawback: they only use the 1-best parse tree to direct the translation, which potentially introduces …

Machine TranslationNMTTranslation