홈 › Papers

SyMCoM - Syntactic Measure of Code Mixing A Study Of English-Hindi Code-Mixing

2022-05-01 · Findings (ACL) 2022 5 · Prashant Kodali, Anmol Goel, Monojit Choudhury, Manish Shrivastava, Ponnurangam Kumaraguru

Code mixing is the linguistic phenomenon where bilingual speakers tend to switch between two or more languages in conversations. Recent work on code-mixing in computational settings has leveraged social media code mixed texts to train NLP models. For capturing the variety of code mixing in, and across corpus, Language ID (LID) tags based measures (CMI) have been proposed. Syntactical variety/patterns of code-mixing and their relationship vis-a-vis computational model’s performance is under explored. In this work, we investigate a collection of English(en)-Hindi(hi) code-mixed datasets from a syntactic lens to propose, SyMCoM, an indicator of syntactic variety in code-mixed text, with intuitive theoretical bounds. We train SoTA en-hi PoS tagger, accuracy of 93.4%, to reliably compute PoS tags on a corpus, and demonstrate the utility of SyMCoM by applying it on various syntactical categories on a collection of datasets, and compare datasets using the measure.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

POS

Homophone Disambiguation Reveals Patterns of Context Mixing in Speech Transformers

2023-10-15 · Hosein Mohebbi, Grzegorz Chrupała, Willem Zuidema, Afra Alishahi

Transformers have become a key architecture in speech processing, but our understanding of how they build up representations of acoustic and linguistic structure is limited. In this study, we address this gap by investig…

Decoder speech-recognition Speech Recognition

Cross-Lingual Dependency Parsing Using Code-Mixed TreeBank

2019-09-05 · IJCNLP 2019 11 · Zhang Meishan, Zhang Yue, Fu Guohong

Treebank translation is a promising method for cross-lingual transfer of syntactic dependency knowledge. The basic idea is to map dependency arcs from a source treebank to its target translation according to word alignme…

Cross-Lingual Transfer Cross-Lingual Word Embeddings Dependency Parsing Translation+1

Word Embeddings for Code-Mixed Language Processing

2018-10-01 · EMNLP 2018 10 · Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram

We compare three existing bilingual word embedding approaches, and a novel approach of training skip-grams on synthetic code-mixed text generated through linguistic models of code-mixing, on two tasks - sentiment analysi…

Machine Translation POS POS Tagging Sentiment Analysis+1

Code-mixed LLM: Improve Large Language Models' Capability to Handle Code-Mixing through Reinforcement Learning from AI Feedback

2024-11-13 · Wenbo Zhang, Aditya Majumdar, Amulya Yadav

Code-mixing(CM) or code-switching(CSW) refers to the juxtaposition of linguistic units from two or more languages during the conversation or sometimes even a single utterance. Code-mixing introduces unique challenges in …

Machine Translation reinforcement-learning Reinforcement Learning

gundapusunil at SemEval-2020 Task 9: Syntactic Semantic LSTM Architecture for SENTIment Analysis of Code-MIXed Data

2020-10-09 · SEMEVAL 2020 · Sunil Gundapu, Radhika Mamidi

The phenomenon of mixing the vocabulary and syntax of multiple languages within the same utterance is called Code-Mixing. This is more evident in multilingual societies. In this paper, we have developed a system for SemE…

Sentiment Analysis Word Embeddings