SilverAlign: MT-Based Silver Data Algorithm For Evaluating Word Alignment
Word alignments are essential for a variety of NLP tasks. Therefore, choosing the best approaches for their creation is crucial. However, the scarce availability of gold evaluation data makes the choice difficult. We propose SilverAlign, a new method to automatically create silver data for the evaluation of word aligners by exploiting machine translation and minimal pairs. We show that performance on our silver data correlates well with gold benchmarks for 9 language pairs, making our approach a valid resource for evaluation of different domains and languages when gold data are not available. This addresses the important scenario of missing gold data alignments for low-resource languages.
Code (1)
Tasks
Machine TranslationTranslationvalidWord AlignmentSimilar Papers 제목 키워드 기반
SiLVERScore: Semantically-Aware Embeddings for Sign Language Generation Evaluation
Evaluating sign language generation is often done through back-translation, where generated signs are first recognized back to text and then compared to a reference using text-based metrics. However, this two-step evalua…
Method Entity Extraction from Biomedical Texts
In the field of Natural Language Processing (NLP), extracting method entities from biomedical text has been a challenging task. Scientific research papers commonly consist of complex keywords and domain-specific terminol…
Dependency ParsingSentenceEvaluating Document Representations for Content-based Legal Literature Recommendations
Recommender systems assist legal professionals in finding relevant literature for supporting their case. Despite its importance for the profession, legal applications do not reflect the latest advances in recommender sys…
Recommendation SystemsRepresentation LearningSemantic SimilarityUCPhrase: Unsupervised Context-aware Quality Phrase Tagging
Identifying and understanding quality phrases from context is a fundamental task in text mining. The most challenging part of this task arguably lies in uncommon, emerging, and domain-specific phrases. The infrequent nat…
Keyphrase ExtractionLanguage ModellingPhrase RankingPhrase Tagging+1Enriching the WebNLG corpus
This paper describes the enrichment of WebNLG corpus (Gardent et al., 2017a,b), with the aim to further extend its usefulness as a resource for evaluating common NLG tasks, including Discourse Ordering, Lexicalization an…
Machine TranslationReferring ExpressionReferring expression generationText Generation+1