EvalD Reference-Less Discourse Evaluation for WMT18
We present the results of automatic evaluation of discourse in machine translation (MT) outputs using the EVALD tool. EVALD was originally designed and trained to assess the quality of \textit{human} writing, for native speakers and foreign-language learners. MT has seen a tremendous leap in translation quality at the level of sentences and it is thus interesting to see if the human-level evaluation is becoming relevant.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Introducing EVALD -- Software Applications for Automatic Evaluation of Discourse in Czech
In the paper, we introduce two software applications for automatic evaluation of coherence in Czech texts called EVALD {--} Evaluator of Discourse. The first one {--} EVALD 1.0 {--} evaluates texts written by native spea…
EvaLDA: Efficient Evasion Attacks Towards Latent Dirichlet Allocation
As one of the most powerful topic models, Latent Dirichlet Allocation (LDA) has been used in a vast range of tasks, including document understanding, information retrieval and peer-reviewer assignment. Despite its tremen…
document understandingInformation RetrievalRetrievalSentiment Analysis+1Segmentation evaluation metrics, a comparison grounded on prosodic and discourse units
Knowledge on evaluation metrics and best practices of using them have improved fast in the recent years Fort et al. (2012). However, the advances concern mostly evaluation of classification related tasks. Segmentation ta…
Discourse SegmentationInformation RetrievalSegmentationAn Exercise in Reuse of Resources: Adapting General Discourse Coreference Resolution for Detecting Lexical Chains in Patent Documentation
The Stanford Coreference Resolution System (StCR) is a multi-pass, rule-based system that scored best in the CoNLL 2011 shared task on general discourse coreference resolution. We describe how the StCR has been adapted t…
coreference-resolutionCoreference ResolutionDomain AdaptationNamed Entity Recognition (NER)Assessing Crosslingual Discourse Relations in Machine Translation
In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant progress has been achieved, especially rec…
Machine TranslationTranslation