Identifying Word Translations from Comparable Documents Without a Seed Lexicon
The extraction of dictionaries from parallel text corpora is an established technique. However, as parallel corpora are a scarce resource, in recent years the extraction of dictionaries using comparable corpora has obtained increasing attention. In order to find a mapping between languages, almost all approaches suggested in the literature rely on a seed lexicon. The work described here achieves competitive results without requiring such a seed lexicon. Instead it presupposes mappings between comparable documents in different languages. For some common types of textual resources (e.g. encyclopedias or newspaper texts) such mappings are either readily available or can be established relatively easily. The current work is based on Wikipedias where the mappings between languages are determined by the authors of the articles. We describe a neural-network inspired algorithm which first characterizes each Wikipedia article by a number of keywords, and then considers the identification of word translations as a variant of word alignment in a noisy environment. We present results and evaluations for eight language pairs involving Germanic, Romanic, and Slavic languages as well as Chinese.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesWord AlignmentSimilar Papers 제목 키워드 기반
Extracting Multiword Translations from Aligned Comparable Documents
Detecting Highly Confident Word Translations from Comparable Corpora without Any Prior Knowledge
Detecting Cross-Language Plagiarism using Open Knowledge Graphs
Identifying cross-language plagiarism is challenging, especially for distant language pairs and sense-for-sense translations. We introduce the new multilingual retrieval model Cross-Language Ontology-Based Similarity Ana…
Knowledge GraphsMachine TranslationRetrievalCross-lingual Opinions and Emotions Mining in Comparable Documents
Comparable texts are topic-aligned documents in multiple languages that are not direct translations. They are valuable for understanding how a topic is discussed across languages. This research studies differences in sen…
Machine TranslationCross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher
Cross-lingual text classification alleviates the need for manually labeled documents in a target language by leveraging labeled documents from other languages. Existing approaches for transferring supervision across lang…
General ClassificationRepresentation Learningtext-classificationText Classification