Building Language Models for Text with Named Entities
Text in many domains involves a significant amount of named entities. Predict- ing the entity names is often challenging for a language model as they appear less frequent on the training corpus. In this paper, we propose a novel and effective approach to building a discriminative language model which can learn the entity names by leveraging their entity type information. We also introduce two benchmark datasets based on recipes and Java programming codes, on which we evalu- ate the proposed model. Experimental re- sults show that our model achieves 52.2% better perplexity in recipe generation and 22.06% on code generation than the state-of-the-art language models.
Code (2)
Tasks
Code GenerationLanguage ModelingLanguage ModellingRecipe GenerationSimilar Papers 제목 키워드 기반
Named Entity Recognition in Indian court judgments
Identification of named entities from legal texts is an essential building block for developing other legal Artificial Intelligence applications. Named Entities in legal texts are slightly different and more fine-grained…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERBuilding Hierarchically Disentangled Language Models for Text Generation with Named Entities
Named entities pose a unique challenge to traditional methods of language modeling. While several domains are characterised with a high proportion of named entities, the occurrence of specific entities varies widely. Coo…
Dependency ParsingLanguage ModelingLanguage Modellingnamed-entity-recognition+7Personal Entity, Concept, and Named Entity Linking in Conversations
Building conversational agents that can have natural and knowledge-grounded interactions with humans requires understanding user utterances. Entity Linking (EL) is an effective and widely used method for understanding na…
coreference-resolutionCoreference ResolutionEntity LinkingTagging Location Phrases in Text
For over thirty years researchers have studied the problem of automatically detecting named entities in written language. Throughout this time the majority of such work has focused on detection and classification of enti…
HumanitarianLanguage-Independent Named Entity Analysis Using Parallel Projection and Rule-Based Disambiguation
The 2017 shared task at the Balto-Slavic NLP workshop requires identifying coarse-grained named entities in seven languages, identifying each entity{'}s base form, and clustering name mentions across the multilingual set…
Clusteringnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)