Rare but Severe Errors Induced by Minimal Deletions in English-Chinese Neural Machine Translation
We examine the inducement of rare but severe errors in English-Chinese and Chinese-English Transformer-based neural machine translation by minimal deletion in the source text. We also examine the effect of training data size on the number and types of pathological cases induced by these perturbations, finding significant variation. We find that one type of hallucination can be remedied through data preprocessing and that deleting words hurts more than deleting characters in a character-based model, even though deleting characters introduces nonsense words.
Code (0)
등록된 구현이 없습니다.
Tasks
HallucinationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and English
We examine the inducement of rare but severe errors in English-Chinese and Chinese-English in-domain neural machine translation by minimal deletion of the source text with character-based models. By deleting a single cha…
Machine TranslationTranslationSynthesis of Static Test Environments for Observing Sequence-like Behaviors in Autonomous Systems
In this paper, we investigate formal test-case generation for high-level mission objectives, specifically reachability, of autonomous systems. We use Kripke structures to represent the high-level decision-making of the a…
Decision MakingNon-Blocking Robustness Analysis in Discrete Event Systems
This paper presents a mathematical framework for characterizing state blocking in discrete event systems (DES) under transition deletions. We introduce a path-based analysis approach that determines whether systems maint…
BlockingDeceptive Deletions for Protecting Withdrawn Posts on Social Platforms
Over-sharing poorly-worded thoughts and personal information is prevalent on online social platforms. In many of these cases, users regret posting such content. To retrospectively rectify these errors in users' sharing d…
Differences between SMT and NMT Output - a Translators' Point of View
In this study, we compare the output quality of two MT systems, a statistical (SMT) and a neural (NMT) engine, customised for Swiss Post{'}s Language Service using the same training data. We focus on the point of view of…
NMT