Adding Distributional Semantics to Knowledge Base Entities through Web-scale Entity Linking

DRCoVe: An Augmented Word Representation Approach using Distributional and Relational Context

Word representation using the distributional information of words from a sizeable corpus is considered efficacious in many natural language processing and text mining applications. However, distributional representation …

Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers?

Formal, Distributional, and Grounded theories of computational semantics each have their uses and their drawbacks. There has been a shift to ground models of language by adding visual knowledge, and there has been a call…

Entity Type Recognition using an Ensemble of Distributional Semantic Models to Enhance Query Understanding

We present an ensemble approach for categorizing search query entities in the recruitment domain. Understanding the types of entities expressed in a search query (Company, Skill, Job Title, etc.) enables more intelligent…

Concept Extensions as the Basis for Vector-Space Semantics: Combining Distributional and Ontological Information about Entities

Knowledge-Aware Language Model Pretraining

How much knowledge do pretrained language models hold? Recent research observed that pretrained transformers are adept at modeling semantics but it is unclear to what degree they grasp human knowledge, or how to ensure t…