TexSmart: A System for Enhanced Natural Language Understanding
This paper introduces TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. Compared to most previous publicly available text understanding systems and tools, TexSmart holds some unique features. First, the NER function of TexSmart supports over 1,000 entity types, while most other public tools typically support several to (at most) dozens of entity types. Second, TexSmart introduces new semantic analysis functions like semantic expansion and deep semantic representation, that are absent in most previous systems. Third, a spectrum of algorithms (from very fast algorithms to those that are relatively slow but more accurate) are implemented for one function in TexSmart, to fulfill the requirements of different academic and industrial applications. The adoption of unsupervised or weakly-supervised algorithms is especially emphasized, with the goal of easily updating our models to include fresh data with less human annotation efforts.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language UnderstandingNERSimilar Papers 제목 키워드 기반
TexSmart: A Text Understanding System for Fine-Grained NER and Enhanced Semantic Analysis
This technique report introduces TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. Compared to most previous publicly availabl…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERRobustly Optimized and Distilled Training for Natural Language Understanding
In this paper, we explore multi-task learning (MTL) as a second pretraining step to learn enhanced universal language representation for transformer language models. We use the MTL enhanced representation across several …
Knowledge DistillationMachine Reading ComprehensionMulti-Task LearningNatural Language Inference+2Large Language Models Understand Layout
Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processi…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Enhanced English Universal Dependencies: An Improved Representation for Natural Language Understanding Tasks
Many shallow natural language understanding tasks use dependency trees to extract relations between content words. However, strict surface-structure dependency trees tend to follow the linguistic structure of sentences t…
Implicit RelationsNatural Language UnderstandingNon-Natural Image Understanding with Advancing Frequency-based Vision Encoders
Large language models (LLMs) have significantly enhanced cross-modal understanding capabilities by integrating visual encoders with textual embeddings, giving rise to multimodal large language models (MLLMs). However…