Evaluating Translation Quality and CLIR Performance of Query Sessions
This paper presents the evaluation of the translation quality and Cross-Lingual Information Retrieval (CLIR) performance when using session information as the context of queries. The hypothesis is that previous queries provide context that helps to solve ambiguous translations in the current query. We tested several strategies on the TREC 2010 Session track dataset, which includes query reformulations grouped by generalization, specification, and drifting types. We study the Basque to English direction, evaluating both the translation quality and CLIR performance, with positive results in both cases. The results show that the quality of translation improved, reducing error rate by 12{\%} (HTER) when using session information, which improved CLIR results 5{\%} (nDCG). We also provide an analysis of the improvements across the three kinds of sessions: generalization, specification, and drifting. Translation quality improved in all three types (generalization, specification, and drifting), and CLIR improved for generalization and specification sessions, preserving the performance in drifting sessions.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual Information RetrievalInformation RetrievalRetrievalTranslationSimilar Papers 제목 키워드 기반
CLIReval: Evaluating Machine Translation as a Cross-Lingual Information Retrieval Task
We present CLIReval, an easy-to-use toolkit for evaluating machine translation (MT) with the proxy task of cross-lingual information retrieval (CLIR). Contrary to what the project name might suggest, CLIReval does not ac…
Cross-Lingual Information RetrievalDocument TranslationInformation RetrievalMachine Translation+2Exploiting Neural Query Translation into Cross Lingual Information Retrieval
As a crucial role in cross-language information retrieval (CLIR), query translation has three main challenges: 1) the adequacy of translation; 2) the lack of in-domain parallel training data; and 3) the requisite of low …
Cross-Lingual Information RetrievalData AugmentationDomain AdaptationInformation Retrieval+4Learning to Exploit Different Translation Resources for Cross Language Information Retrieval
One of the important factors that affects the performance of Cross Language Information Retrieval(CLIR)is the quality of translations being employed in CLIR. In order to improve the quality of translations, it is importa…
Information RetrievalLearning-To-RankRetrievalTranslationIdentifying Effective Translations for Cross-lingual Arabic-to-English User-generated Speech Search
Cross Language Information Retrieval (CLIR) systems are a valuable tool to enable speakers of one language to search for content of interest expressed in a different language. A group for whom this is of particular inter…
Information RetrievalMachine TranslationRetrievalTranslationMuSeCLIR: A Multiple Senses and Cross-lingual Information Retrieval Dataset
This paper addresses a deficiency in existing cross-lingual information retrieval (CLIR) datasets and provides a robust evaluation of CLIR systems’ disambiguation ability. CLIR is commonly tackled by combining translatio…
Cross-Lingual Information RetrievalInformation RetrievalRetrievalTranslation