Probabilistic Inference for Cold Start Knowledge Base Population with Prior World Knowledge
Building knowledge bases (KB) automatically from text corpora is crucial for many applications such as question answering and web search. The problem is very challenging and has been divided into sub-problems such as mention and named entity recognition, entity linking and relation extraction. However, combining these components has shown to be under-constrained and often produces KBs with supersize entities and common-sense errors in relations (a person has multiple birthdates). The errors are difficult to resolve solely with IE tools but become obvious with world knowledge at the corpus level. By analyzing Freebase and a large text collection, we found that per-relation cardinality and the popularity of entities follow the power-law distribution favoring flat long tails with low-frequency instances. We present a probabilistic joint inference algorithm to incorporate this world knowledge during KB construction. Our approach yields state-of-the-art performance on the TAC Cold Start task, and 42{\%} and 19.4{\%} relative improvements in F1 over our baseline on Cold Start hop-1 and all-hop queries respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningEntity LinkingKnowledge Base Populationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Question AnsweringRelationRelation ExtractionWorld KnowledgeSimilar Papers 제목 키워드 기반
Alleviating Cold-start Problem in CTR Prediction with A Variational Embedding Learning Framework
We propose a general Variational Embedding Learning Framework (VELF) for alleviating the severe cold-start problem in CTR prediction. VELF addresses the cold start problem via alleviating over-fits caused by data-sparsit…
Click-Through Rate PredictionVariational InferenceA Probabilistic Model for the Cold-Start Problem in Rating Prediction using Click Data
One of the most efficient methods in collaborative filtering is matrix factorization, which finds the latent vector representations of users and items based on the ratings of users to items. However, a matrix factorizati…
Collaborative FilteringCould Small Language Models Serve as Recommenders? Towards Data-centric Cold-start Recommendations
Recommendation systems help users find matched items based on their previous behaviors. Personalized recommendation becomes challenging in the absence of historical user-item interactions, a practical problem for startup…
In-Context LearningLanguage ModelingLanguage ModellingRecommendation Systems+1On Cold Posteriors of Probabilistic Neural Networks: Understanding the Cold Posterior Effect and A New Way to Learn Cold Posteriors with Tight Generalization Guarantees
Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural networ…
Bayesian InferenceGeneralization BoundsMetaKG: Meta-learning on Knowledge Graph for Cold-start Recommendation
A knowledge graph (KG) consists of a set of interconnected typed entities and their attributes. Recently, KGs are popularly used as the auxiliary information to enable more accurate, explainable, and diverse user prefere…
Meta-Learning