Codeswitching language identification using Subword Information Enriched Word Vectors

Word-Level Language Identification and Predicting Codeswitching Points in Swahili-English Language Data

The Howard University System Submission for the Shared Task in Language Identification in Spanish-English Codeswitching

Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixing

We present a new corpus of Twitter data annotated for codeswitching and borrowing between Spanish and English. The corpus contains 9,500 tweets annotated at the token level with codeswitches, borrowings, and named entiti…

Word-level Language Identification Using Subword Embeddings for Code-mixed Bangla-English Social Media Data

This paper reports work on building a word-level language identification (LID) model for code-mixed Bangla-English social media data using subword embeddings, with an ultimate goal of using this LID module as the first s…

Stem-driven Language Models for Morphologically Rich Languages

Neural language models (LMs) have shown to benefit significantly from enhancing word vectors with subword-level information, especially for morphologically rich languages. This has been mainly tackled by providing subwor…