paper-with-me

Papers

Code-switching Language Modeling With Bilingual Word Embeddings: A Case Study for Egyptian Arabic-English

2019-09-24 · Injy Hamed, Moritz Zhu, Mohamed Elmahdy, Slim Abdennadher, Ngoc Thang Vu

Code-switching (CS) is a widespread phenomenon among bilingual and multilingual societies. The lack of CS resources hinders the performance of many NLP tasks. In this work, we explore the potential use of bilingual word embeddings for code-switching (CS) language modeling (LM) in the low resource Egyptian Arabic-English language. We evaluate different state-of-the-art bilingual word embeddings approaches that require cross-lingual resources at different levels and propose an innovative but simple approach that jointly learns bilingual word representations without the use of any parallel data, relying only on monolingual and a small amount of CS data. While all representations improve CS LM, ours performs the best and improves perplexity 33.5% relative over the baseline.

📄 PDF Abstract BibTeX arXiv:1909.10892

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingWord Embeddings

Similar Papers 제목 키워드 기반

Surprisal Predicts Code-Switching in Chinese-English Bilingual Text

2020-11-01 · EMNLP 2020 11 · Jes{\'u}s Calvillo, Le Fang, Jeremy Cole, David Reitter

Why do bilinguals switch languages within a sentence? The present observational study asks whether word surprisal and word entropy predict code-switching in bilingual written conversation. We describe and model a new dat…

Sentence

Streaming Bilingual End-to-End ASR model using Attention over Multiple Softmax

2024-01-22 · Aditya Patil, Vikas Joshi, Purvi Agrawal, Rupesh Mehta

Even with several advancements in multilingual modeling, it is challenging to recognize multiple languages using a single neural model, without knowing the input language and most multilingual models assume the availabil…

Bilingual Character Representation for Efficiently Addressing Out-of-Vocabulary Words in Code-Switching Named Entity Recognition

2018-05-30 · WS 2018 7 · Genta Indra Winata, Chien-Sheng Wu, Andrea Madotto, Pascale Fung

We propose an LSTM-based model with hierarchical architecture on named entity recognition from code-switching Twitter data. Our model uses bilingual character representation and transfer learning to address out-of-vocabu…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Transfer Learning

Shared Lexical Items as Triggers of Code Switching

2023-08-29 · Shuly Wintner, Safaa Shehadi, Yuli Zeira, Doreen Osmelak 외

Why do bilingual speakers code-switch (mix their two languages)? Among the several theories that attempt to explain this natural and ubiquitous phenomenon, the Triggering Hypothesis relates code-switching to the presence…

A Bilingual Attention Network for Code-switched Emotion Prediction

2016-12-01 · COLING 2016 12 · Zhongqing Wang, Yue Zhang, Sophia Lee, Shoushan Li 외

Emotions in code-switching text can be expressed in either monolingual or bilingual forms. However, relatively little research has emphasized on code-switching text. In this paper, we propose a Bilingual Attention Networ…

Emotion Recognition