TQ-AutoTest -- An Automated Test Suite for (Machine) Translation Quality
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
AutoTestForge: A Multidimensional Automated Testing Framework for Natural Language Processing Models
In recent years, the application of behavioral testing in Natural Language Processing (NLP) model evaluation has experienced a remarkable and substantial growth. However, the existing methods continue to be restricted by…
FairnessSemantic Textual SimilaritySentiment AnalysisSTSAutoTest: Evolutionary Code Solution Selection with Test Cases
With the development of code generation techniques, selecting the correct code solution from multiple candidate solutions has become a crucial task. This study proposes AutoTest, a novel technique that combines automated…
Code GenerationHumanEvalMachine Translation with parfda, Moses, kenlm, nplm, and PRO
We build parfda Moses statistical machine translation (SMT) models for most language pairs in the news translation task. We experiment with a hybrid approach using neural language models integrated into Moses. We obtain …
Machine TranslationTranslationLinguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German
We are using a semi-automated test suite in order to provide a fine-grained linguistic evaluation for state-of-the-art machine translation systems. The evaluation includes 18 German to English and 18 English to German sy…
Machine TranslationTranslationThe Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translation
Does neural machine translation yield translations that are congenial with common sense? In this paper, we present a test suite to evaluate the commonsense reasoning capability of neural machine translation. The test sui…
Common Sense ReasoningMachine TranslationSentenceTranslation