Gender Prediction in English-Hindi Code-Mixed Social Media Content : Corpus and Baseline System
The rapid expansion in the usage of social media networking sites leads to a huge amount of unprocessed user generated data which can be used for text mining. Author profiling is the problem of automatically determining profiling aspects like the author's gender and age group through a text is gaining much popularity in computational linguistics. Most of the past research in author profiling is concentrated on English texts \cite{1,2}. However many users often change the language while posting on social media which is called code-mixing, and it develops some challenges in the field of text classification and author profiling like variations in spelling, non-grammatical structure and transliteration \cite{3}. There are very few English-Hindi code-mixed annotated datasets of social media content present online \cite{4}. In this paper, we analyze the task of author's gender prediction in code-mixed content and present a corpus of English-Hindi texts collected from Twitter which is annotated with author's gender. We also explore language identification of every word in this corpus. We present a supervised classification baseline system which uses various machine learning algorithms to identify the gender of an author using a text, based on character and word level features.
Code (0)
등록된 구현이 없습니다.
Tasks
Author ProfilingGender PredictionGeneral ClassificationLanguage Identificationtext-classificationText ClassificationTransliterationSimilar Papers 제목 키워드 기반
Corpus Creation and Emotion Prediction for Hindi-English Code-Mixed Social Media Text
Emotion Prediction is a Natural Language Processing (NLP) task dealing with detection and classification of emotions in various monolingual and bilingual texts. While some work has been done on code-mixed social media te…
General ClassificationEnabling Code-Mixed Translation: Parallel Corpus Creation and MT Augmentation Approach
Code-mixing, use of two or more languages in a single sentence, is ubiquitous; generated by multi-lingual speakers across the world. The phenomenon presents itself prominently in social media discourse. Consequently, the…
Machine TranslationSentenceTranslationNeither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoders
Multilingual encoder-based language models are widely adopted for code-mixed analysis tasks, yet we know surprisingly little about how they represent code-mixed inputs internally - or whether those representations meanin…
Hate Speech DetectionSentiment AnalysisHate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning Models
This paper reports an increment to the state-of-the-art in hate speech detection for English-Hindi code-mixed tweets. We compare three typical deep learning models using domain-specific embeddings. On experimenting with …
Hate Speech DetectionEvaluation of forced alignment of code-mixed speech: the case of Hindi-English
Code-mixed speech poses unique challenges to forced alignment: expanded inventories, orthographic errors, and speaker variation. We evaluate forced alignment of Hindi-English code-mixed speech using the Montreal Forced A…
Boundary Detection