paper-with-me

홈 › Papers

An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers

2021-05-31 · ACL 2021 5 · Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to maintain several language-specific models. To overcome these problems, we explore different approaches to multilingual, word-level QE. We show that these QE models perform on par with the current language-specific models. In the cases of zero-shot and few-shot QE, we demonstrate that it is possible to accurately predict word-level quality for any given new language pair from models trained on other language pairs. Our findings suggest that the word-level QE models based on powerful pre-trained transformers that we propose in this paper generalise well across languages, making them more useful in real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2106.00143

Code (1)

tharindudr/transQuest 공식 구현 pytorch

Tasks

Machine TranslationTranslation

Similar Papers 제목 키워드 기반

OmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignment

2026-08-19 · Mengpeng Yang, Jingxu Yang, Chao Chen, Tian Xia 외 arxiv

Cross-lingual sequence alignment is fundamental for building and exploiting parallel corpora, spanning mappings from documents and sentences down to words and subwords. Existing tools, however, typically specialize in a …

Long-Context UnderstandingSelf-Supervised LearningWord Alignment

Hierarchical Document Encoder for Parallel Corpus Mining

2019-06-20 · WS 2019 8 · Mandy Guo, Yinfei Yang, Keith Stevens, Daniel Cer 외

We explore using multilingual document embeddings for nearest neighbor mining of parallel data. Three document-level representations are investigated: (i) document embeddings generated by simply averaging multilingual se…

Parallel Corpus MiningSentenceSentence EmbeddingSentence-Embedding+1

An exploratory approach to the Parallel Corpus Filtering shared task WMT20

2020-11-01 · WMT (EMNLP) 2020 11 · Ankur Kejriwal, Philipp Koehn

In this document we describe our submission to the parallel corpus filtering task using multilingual word embedding, language models and an ensemble of pre and post filtering rules. We use the norms of embedding and the …

Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task

2023-09-21 · Ricardo Rei, Nuno M. Guerreiro, José Pombal, Daan van Stigt 외

We present the joint contribution of Unbabel and Instituto Superior T\'ecnico to the WMT 2023 Shared Task on Quality Estimation (QE). Our team participated on all tasks: sentence- and word-level quality prediction (task …

AllSentenceTask 2

Automated Quality Control for Language Documentation: Detecting Phonotactic Inconsistencies in a Kokborok Wordlist

2025-10-24 · Kellen Parker van Dam, Abishek Stephen arxiv

Lexical data collection in language documentation often contains transcription errors and undocumented borrowings that can mislead linguistic analysis. We present unsupervised anomaly detection methods to identify phonot…

Unsupervised Anomaly Detection