paper-with-me

Papers

Sequence to Sequence Networks for Roman-Urdu to Urdu Transliteration

2017-12-08 · Mehreen Alam, Sibt Ul Hussain

Neural Machine Translation models have replaced the conventional phrase based statistical translation methods since the former takes a generic, scalable, data-driven approach rather than relying on manual, hand-crafted features. The neural machine translation system is based on one neural network that is composed of two parts, one that is responsible for input language sentence and other part that handles the desired output language sentence. This model based on encoder-decoder architecture also takes as input the distributed representations of the source language which enriches the learnt dependencies and gives a warm start to the network. In this work, we transform Roman-Urdu to Urdu transliteration into sequence to sequence learning problem. To this end, we make the following contributions. We create the first ever parallel corpora of Roman-Urdu to Urdu, create the first ever distributed representation of Roman-Urdu and present the first neural machine translation model that transliterates text from Roman-Urdu to Urdu language. Our model has achieved the state-of-the-art results using BLEU as the evaluation metric. Precisely, our model is able to correctly predict sentences up to length 10 while achieving BLEU score of 48.6 on the test set. We are hopeful that our model and our results shall serve as the baseline for further work in the domain of neural machine translation for Roman-Urdu to Urdu using distributed representation.

📄 PDF Abstract BibTeX arXiv:1712.02959

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMachine TranslationSentenceTranslationTransliteration

Similar Papers 제목 키워드 기반

Low-Resource Transliteration for Roman-Urdu and Urdu Using Transformer-Based Models

2025-03-27 · Umer Butt, Stalin Veranasi, Günter Neumann

As the Information Retrieval (IR) field increasingly recognizes the importance of inclusivity, addressing the needs of low-resource languages remains a significant challenge. Transliteration between Urdu and its Romanize…

Information RetrievalLanguage ModelingLanguage ModellingMasked Language Modeling+2

Context based Roman-Urdu to Urdu Script Transliteration System

2021-09-29 · H Muhammad Shakeel, Rashid Khan, Muhammad Waheed

Now a day computer is necessary for human being and it is very useful in many fields like search engine, text processing, short messaging services, voice chatting and text recognition. Since last many years there are man…

Transliteration

Urdu - Roman Transliteration via Finite State Transducers

2012-07-01 · WS 2012 7 · Tina B{\"o}gel
Transliteration

A Clustering Framework for Lexical Normalization of Roman Urdu

2020-03-31 · Abdul Rafae Khan, Asim Karim, Hassan Sajjad, Faisal Kamiran 외

Roman Urdu is an informal form of the Urdu language written in Roman script, which is widely used in South Asia for online textual content. It lacks standard spelling and hence poses several normalization challenges duri…

ClusteringLexical Normalization

Learning Trilingual Dictionaries for Urdu -- Roman Urdu -- English

2019-08-01 · WS 2019 8 · Moiz Rauf, Sebastian Pad{\'o}

In this paper, we present an effort to generate a joint Urdu, Roman Urdu and English trilingual lexicon using automated methods. We make a case for using statistical machine translation approaches and parallel corpora fo…

Machine TranslationTranslationWord Alignment