paper-with-me

홈 › Papers

Design Challenges in Named Entity Transliteration

2018-08-07 · COLING 2018 8 · Yuval Merhav, Stephen Ash

We analyze some of the fundamental design challenges that impact the development of a multilingual state-of-the-art named entity transliteration system, including curating bilingual named entity datasets and evaluation of multiple transliteration methods. We empirically evaluate the transliteration task using traditional weighted finite state transducer (WFST) approach against two neural approaches: the encoder-decoder recurrent neural network method and the recent, non-sequential Transformer method. In order to improve availability of bilingual named entity transliteration datasets, we release personal name bilingual dictionaries minded from Wikidata for English to Russian, Hebrew, Arabic and Japanese Katakana. Our code and dictionaries are publicly available.

📄 PDF Abstract BibTeX arXiv:1808.02563

Code (1)

steveash/NETransliteration-COLING2018 공식 구현 tf

Tasks

DecoderTransliteration

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

ANETAC: Arabic Named Entity Transliteration and Classification Dataset

2019-07-06 · Mohamed Seghir Hadj Ameur, Farid Meziane, Ahmed Guessoum

In this paper, we make freely accessible ANETAC our English-Arabic named entity transliteration and classification dataset that we built from freely available parallel translation corpora. The dataset contains 79,924 ins…

ClassificationGeneral ClassificationTranslationTransliteration+1

Neural Machine Translation Techniques for Named Entity Transliteration

2018-07-01 · WS 2018 7 · Roman Grundkiewicz, Kenneth Heafield

Transliterating named entities from one language into another can be approached as neural machine translation (NMT) problem, for which we use deep attentional RNN encoder-decoder models. To build a strong transliteration…

Automatic Post-EditingDecoderGrammatical Error CorrectionMachine Translation+3

Report of NEWS 2018 Named Entity Transliteration Shared Task

2018-07-01 · WS 2018 7 · Nancy Chen, Rafael E. Banchs, Min Zhang, Xiangyu Duan 외

This report presents the results from the Named Entity Transliteration Shared Task conducted as part of The Seventh Named Entities Workshop (NEWS 2018) held at ACL 2018 in Melbourne, Australia. Similar to previous editio…

Information RetrievalMachine TranslationTransliteration

Cross-lingual Named Entity List Search via Transliteration

2020-05-01 · LREC 2020 5 · Aleks Khakhmovich, R, Svetlana Pavlova, Kira Kirillova 외

Out-of-vocabulary words are still a challenge in cross-lingual Natural Language Processing tasks, for which transliteration from source to target language or script is one of the solutions. In this study, we collect a pe…

Transliteration

A Myanmar (Burmese)-English Named Entity Transliteration Dictionary

2020-05-01 · LREC 2020 5 · Aye Myat Mon, Chenchen Ding, Hour Kaing, Khin Mar Soe 외

Transliteration is generally a phonetically based transcription across different writing systems. It is a crucial task for various downstream natural language processing applications. For the Myanmar (Burmese) language, …

Transliteration