CALCS 2021 Shared Task: Machine Translation for Code-Switched Data
To date, efforts in the code-switching literature have focused for the most part on language identification, POS, NER, and syntactic parsing. In this paper, we address machine translation for code-switched social media data. We create a community shared task. We provide two modalities for participation: supervised and unsupervised. For the supervised setting, participants are challenged to translate English into Hindi-English (Eng-Hinglish) in a single direction. For the unsupervised setting, we provide the following language pairs: English and Spanish-English (Eng-Spanglish), and English and Modern Standard Arabic-Egyptian Arabic (Eng-MSAEA) in both directions. We share insights and challenges in curating the "into" code-switching language evaluation data. Further, we provide baselines for all language pairs in the shared task. The leaderboard for the shared task comprises 12 individual system submissions corresponding to 5 different teams. The best performance achieved is 12.67% BLEU score for English to Hinglish and 25.72% BLEU score for MSAEA to English.
Code (0)
등록된 구현이 없습니다.
Tasks
Language IdentificationMachine TranslationNERPOSTranslationSimilar Papers 제목 키워드 기반
IITP-MT at CALCS2021: English to Hinglish Neural Machine Translation using Unsupervised Synthetic Code-Mixed Parallel Corpus
This paper describes the system submitted by IITP-MT team to Computational Approaches to Linguistic Code-Switching (CALCS 2021) shared task on MT for English→Hinglish. We submit a neural machine translation (NMT) system …
Machine TranslationNMTTranslationNamed Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task
In the third shared task of the Computational Approaches to Linguistic Code-Switching (CALCS) workshop, we focus on Named Entity Recognition (NER) on code-switched social-media data. We divide the shared task into two co…
Diversitynamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2GHHT at CALCS 2018: Named Entity Recognition for Dialectal Arabic Using Neural Networks
This paper describes our system submission to the CALCS 2018 shared task on named entity recognition on code-switched data for the language variant pair of Modern Standard Arabic and Egyptian dialectal Arabic. We build a…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Code-Switched Named Entity Recognition with Embedding Attention
We describe our work for the CALCS 2018 shared task on named entity recognition on code-switched data. Our system ranked first place for MS Arabic-Egyptian named entity recognition and third place for English-Spanish.
Language Identificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1CaLcs: Continuously Approximating Longest Common Subsequence for Sequence Level Optimization
Maximum-likelihood estimation (MLE) is one of the most widely used approaches for training structured prediction models for text-generation based natural language processing applications. However, besides exposure bias, …
Abstractive Text SummarizationImage CaptioningMachine TranslationPolicy Gradient Methods+4