Twitter Universal Dependency Parsing for African-American and Mainstream American English
Due to the presence of both Twitter-specific conventions and non-standard and dialectal language, Twitter presents a significant parsing challenge to current dependency parsing tools. We broaden English dependency parsing to handle social media English, particularly social media African-American English (AAE), by developing and annotating a new dataset of 500 tweets, 250 of which are in AAE, within the Universal Dependencies 2.0 framework. We describe our standards for handling Twitter- and AAE-specific features and evaluate a variety of cross-domain strategies for improving parsing with no, or very little, in-domain labeled data, including a new data synthesis approach. We analyze these methods{'} impact on performance disparities between AAE and Mainstream American English tweets, and assess parsing accuracy for specific AAE lexical and syntactic features. Our annotated data and a parsing model are available at: \url{http://slanglab.cs.umass.edu/TwitterAAE/}.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingInformation RetrievalLanguage IdentificationPart-Of-Speech TaggingSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Demographic Dialectal Variation in Social Media: A Case Study of African-American English
Though dialectal language is increasingly abundant on social media, few resources exist for developing NLP tools to handle such language. We conduct a case study of dialectal language in online conversational text by inv…
Dependency ParsingLanguage IdentificationCross-Dialect Social Media Dependency Parsing for Social Scientific Entity Attribute Analysis
In this paper, we utilize recent advancements in social media natural language processing to obtain state-of-the-art syntactic dependency parsing results for social media English. We observe performance gains of 3.4 UAS …
AttributeDependency ParsingNew syntactic insights for automated Wolof Universal Dependency parsing
Focus on language-specific properties with insights from formal minimalist syntax can improve universal dependency (UD) parsing. Such improvements are especially sensitive for low-resource African languages, like Wolof, …
Dependency ParsingNow We Stronger than Ever: African-American English Syntax in Twitter
Evaluating the Usage of African-American Vernacular English in Large Language Models
In AI, most evaluations of natural language understanding tasks are conducted in standardized dialects such as Standard American English (SAE). In this work, we investigate how accurately large language models (LLMs) rep…
Natural Language UnderstandingSentiment Analysis