A Cross-Lingual Dictionary for English Wikipedia Concepts
We present a resource for automatically associating strings of text with English Wikipedia concepts. Our machinery is bi-directional, in the sense that it uses the same fundamental probabilistic methods to map strings to empirical distributions over Wikipedia articles as it does to map article URLs to distributions over short, language-independent strings of natural language text. For maximal inter-operability, we release our resource as a set of flat line-based text files, lexicographically sorted and encoded with UTF-8. These files capture joint probability distributions underlying concepts (we use the terms article, concept and Wikipedia URL interchangeably) and associated snippets of text, as well as other features that can come in handy when working with Wikipedia articles and related information.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesEntity LinkingInformation RetrievalSimilar Papers 제목 키워드 기반
Cross-lingual Dataless Classification for Languages with Small Wikipedia Presence
This paper presents an approach to classify documents in any language into an English topical label space, without any text categorization training data. The approach, Cross-Lingual Dataless Document Classification (CLDD…
ClassificationDocument ClassificationGeneral ClassificationMachine Translation+2Cross-Lingual UMLS Named Entity Linking using UMLS Dictionary Fine-Tuning
We study cross-lingual UMLS named entity linking, where mentions in a given source language are mapped to UMLS concepts, most of which are labeled in English. Our cross-lingual framework includes an offline unsupervised …
Entity LinkingLanguage ModelingLanguage ModellingIllinois Cross-Lingual Wikifier: Grounding Entities in Many Languages to the English Wikipedia
We release a cross-lingual wikification system for all languages in Wikipedia. Given a piece of text in any supported language, the system identifies names of people, locations, organizations, and grounds these names to …
Cross-Lingual NEREntity Linkingnamed-entity-recognitionNamed Entity Recognition+2Cross-Lingual UMLS Named Entity Linking using UMLS Dictionary Fine-Tuning
We study cross-lingual UMLS named entity linking, where mentions in a given source language are mapped to UMLS concepts, most of which are labeled in English. We propose a general solution that can be easily adapted to a…
DescriptiveEntity LinkingLanguage ModellingBuilding and Aligning Comparable Corpora
Comparable corpus is a set of topic aligned documents in multiple languages, which are not necessarily translations of each other. These documents are useful for multilingual natural language processing when there is no …