Aligning Multilingual Embeddings for Improved Code-switched Natural Language Understanding
Multilingual pretrained models, while effective on monolingual data, need additional training to work well with code-switched text. In this work, we present a novel idea of training multilingual models with alignment objectives using parallel text so as to explicitly align word representations with the same underlying semantics across languages. Such an explicit alignment step has a positive downstream effect and improves performance on multiple code-switched NLP tasks. We explore two alignment strategies and report improvements of up to 7.32%, 0.76% and 1.9% on Hindi-English Sentiment Analysis, Named Entity Recognition and Question Answering tasks compared to a competitive baseline model.
Code (1)
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language UnderstandingQuestion AnsweringSentiment AnalysisSimilar Papers 제목 키워드 기반
CS-Embed at SemEval-2020 Task 9: The effectiveness of code-switched word embeddings for sentiment analysis
The growing popularity and applications of sentiment analysis of social media posts has naturally led to sentiment analysis of posts written in multiple languages, a practice known as code-switching. While recent researc…
Multilingual Word EmbeddingsSentiment AnalysisWord EmbeddingsAdapting Deep Learning for Sentiment Classification of Code-Switched Informal Short Text
Nowadays, an abundance of short text is being generated that uses nonstandard writing styles influenced by regional languages. Such informal and code-switched content are under-resourced in terms of labeled datasets and …
ClassificationGeneral ClassificationLexical NormalizationSentiment Analysis+2Mind Your Language: Abuse and Offense Detection for Code-Switched Languages
In multilingual societies like the Indian subcontinent, use of code-switched languages is much popular and convenient for the users. In this paper, we study offense and abuse detection in the code-switched pair of Hindi …
Abuse DetectionGeneral ClassificationTransfer LearningSentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation
With increasing globalization and immigration, various studies have estimated that about half of the world population is bilingual. Consequently, individuals concurrently use two or more languages or dialects in casual c…
Semantic SimilaritySemantic Textual SimilaritySentiment AnalysisSentiment ClassificationBoosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data
Transferring information retrieval (IR) models from a high-resource language (typically English) to other languages in a zero-shot fashion has become a widely adopted approach. In this work, we show that the effectivenes…
Cross-Lingual Word EmbeddingsInformation RetrievalRerankingRetrieval+1