DELA Project: Document-level Machine Translation Evaluation
This paper presents the results of the DELA Project. We describe the testing of context span for document-level evaluation, construction of a document-level corpus, and context position, as well as the latest developments of the project when looking at human and automatic evaluation metrics for document-level evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Document Level Machine TranslationMachine TranslationPositionTranslationSimilar Papers 제목 키워드 기반
Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement
Document-level (doc-level) human eval-uation of machine translation (MT) has raised interest in the community after a fewattempts have disproved claims of “human parity” (Toral et al., 2018; Laubli et al.,2018). However,…
Document Level Machine TranslationMachine TranslationSentenceTranslationDELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues
Recently, the Machine Translation (MT) community has become more interested in document-level evaluation especially in light of reactions to claims of “human parity”, since examining the quality at the level of the docum…
Machine TranslationSentenceTranslationELITR: European Live Translator
ELITR (European Live Translator) project aims to create a speech translation system for simultaneous subtitling of conferences and online meetings targetting up to 43 languages. The technology is tested by the Supreme Au…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+2Machine Translation Between High-resource Languages in a Language Documentation Setting
Language documentation encompasses translation, typically into the dominant high-resource language in the region where the target language is spoken. To make data accessible to a broader audience, additional translation …
Machine TranslationTranslationVocal Bursts Intensity PredictionWhat Does LLM Refinement Actually Improve? A Systematic Study on Document-Level Literary Translation
Iterative self-refinement is a simple inference-time strategy for machine translation: an LLM revises its own translation over multiple inference-time passes. Yet document-scale refinement remains poorly understood: 1) w…
Machine Translation