A POS Tagger for Code Mixed Indian Social Media Text - ICON-2016 NLP Tools Contest Entry from Surukam

2016-12-31 · Sree Harsha Ramesh, Raveena R Kumar

Building Part-of-Speech (POS) taggers for code-mixed Indian languages is a particularly challenging problem in computational linguistics due to a dearth of accurately annotated training corpora. ICON, as part of its NLP tools contest has organized this challenge as a shared task for the second consecutive year to improve the state-of-the-art. This paper describes the POS tagger built at Surukam to predict the coarse-grained and fine-grained POS tags for three language pairs - Bengali-English, Telugu-English and Hindi-English, with the text spanning three popular social media platforms - Facebook, WhatsApp and Twitter. We employed Conditional Random Fields as the sequence tagging algorithm and used a library called sklearn-crfsuite - a thin wrapper around CRFsuite for training our model. Among the features we used include - character n-grams, language information and patterns for emoji, number, punctuation and web-address. Our submissions in the constrained environment,i.e., without making any use of monolingual POS taggers or the like, obtained an overall average F1-score of 76.45%, which is comparable to the 2015 winning score of 76.79%.

📄 PDF Abstract BibTeX arXiv:1701.00066

Code (0)

등록된 구현이 없습니다.

Tasks

POS

A CRF Based POS Tagger for Code-mixed Indian Social Media Text

2016-12-23 · Kamal Sarkar

In this work, we describe a conditional random fields (CRF) based system for Part-Of- Speech (POS) tagging of code-mixed Indian social media text as part of our participation in the tool contest on POS tagging for codemi…

Part-Of-Speech Tagging POS POS Tagging

Recurrent Neural Network based Part-of-Speech Tagger for Code-Mixed Social Media Text

2016-11-15 · Raj Nath Patel, Prakash B. Pimpale, M Sasikumar

This paper describes Centre for Development of Advanced Computing's (CDACM) submission to the shared task-'Tool Contest on POS tagging for Code-Mixed Indian Social Media (Facebook, Twitter, and Whatsapp) Text', collocate…

Language Modeling Language Modelling POS POS Tagging+1

SMPOST: Parts of Speech Tagger for Code-Mixed Indic Social Media Text

2017-02-01 · Deepak Gupta, Shubham Tripathi, Asif Ekbal, Pushpak Bhattacharyya

Use of social media has grown dramatically during the last few years. Users follow informal languages in communicating through social media. The language of communication is often mixed in nature, where people transcribe…

Part-Of-Speech Tagging POS POS Tagging Sentence+1

Identifying Languages at the Word Level in Code-Mixed Indian Social Media Text

2014-12-01 · WS 2014 12 · Amitava Das, Bj{\"o}rn Gamb{\"a}ck

Language Identification

Experiments with POS Tagging Code-mixed Indian Social Media Text

2016-10-31 · Prakash B. Pimpale, Raj Nath Patel

This paper presents Centre for Development of Advanced Computing Mumbai's (CDACM) submission to the NLP Tools Contest on Part-Of-Speech (POS) Tagging For Code-mixed Indian Social Media Text (POSCMISMT) 2015 (collocated w…

Part-Of-Speech Tagging POS POS Tagging TAG