Improving Downstream Task Performance by Treating Numbers as Entities
Numbers are essential components of text, like any other word tokens, from which natural language processing (NLP) models are built and deployed. Though numbers are typically not accounted for distinctly in most NLP tasks, there is still an underlying amount of numeracy already exhibited by NLP models. In this work, we attempt to tap this potential of state-of-the-art NLP models and transfer their ability to boost performance in related tasks. Our proposed classification of numbers into entities helps NLP models perform well on several tasks, including a handcrafted Fill-In-The-Blank (FITB) task and on question answering using joint embeddings, outperforming the BERT and RoBERTa baseline classification.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationQuestion AnsweringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
InclusiveFaceNet: Improving Face Attribute Detection with Race and Gender Diversity
We demonstrate an approach to face attribute detection that retains or improves attribute detection accuracy across gender and race subgroups by learning demographic information prior to learning the attribute detection …
AttributeDiversityText Sanitization Beyond Specific Domains: Zero-Shot Redaction & Substitution with Large Language Models
In the context of information systems, text sanitization techniques are used to identify and remove sensitive data to comply with security and regulatory requirements. Even though many methods for privacy preservation ha…
GenIE: Generative Information Extraction
Structured and grounded representation of text is typically formalized by closed information extraction, the problem of extracting an exhaustive set of (subject, relation, object) triplets that are consistent with a pred…
Relation ExtractionContrastive Learning and Abstract Concepts: The Case of Natural Numbers
Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so …
Contrastive LearningIce hockey player identification via transformers and weakly supervised learning
Identifying players in video is a foundational step in computer vision-based sports analytics. Obtaining player identities is essential for analyzing the game and is used in downstream tasks such as game event recognitio…
Optical Character RecognitionOptical Character Recognition (OCR)Sports AnalyticsTemporal Sequences+1