Reinforced Negative Sampling over Knowledge Graph for Recommendation
Properly handling missing data is a fundamental challenge in recommendation. Most present works perform negative sampling from unobserved data to supply the training of recommender models with negative signals. Nevertheless, existing negative sampling strategies, either static or adaptive ones, are insufficient to yield high-quality negative samples --- both informative to model training and reflective of user real needs. In this work, we hypothesize that item knowledge graph (KG), which provides rich relations among items and KG entities, could be useful to infer informative and factual negative samples. Towards this end, we develop a new negative sampling model, Knowledge Graph Policy Network (KGPolicy), which works as a reinforcement learning agent to explore high-quality negatives. Specifically, by conducting our designed exploration operations, it navigates from the target positive interaction, adaptively receives knowledge-aware negative signals, and ultimately yields a potential negative item to train the recommender. We tested on a matrix factorization (MF) model equipped with KGPolicy, and it achieves significant improvements over both state-of-the-art sampling methods like DNS and IRGAN, and KG-enhanced recommender models like KGAT. Further analyses from different angles provide insights of knowledge-aware sampling. We release the codes and datasets at https://github.com/xiangwang1223/kgpolicy.
Code (1)
Tasks
Reinforcement LearningSimilar Papers 제목 키워드 기반
Diversified and Adaptive Negative Sampling on Knowledge Graphs
In knowledge graph embedding, aside from positive triplets (ie: facts in the knowledge graph), the negative triplets used for training also have a direct influence on the model performance. In reality, since knowledge gr…
Graph EmbeddingInformativenessKnowledge Graph EmbeddingKnowledge Graphs+1Efficient Non-Sampling Knowledge Graph Embedding
Knowledge Graph (KG) is a flexible structure that is able to describe the complex relationship between data entities. Currently, most KG embedding models are trained based on negative sampling, i.e., the model aims to ma…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling
Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of g…
Knowledge Graph CompletionKnowledge GraphsLink PredictionWorld KnowledgeAnalysis of the Impact of Negative Sampling on Link Prediction in Knowledge Graphs
Knowledge graphs are large, useful, but incomplete knowledge repositories. They encode knowledge through entities and relations which define each other through the connective structure of the graph. This has inspired met…
Knowledge Graph EmbeddingsKnowledge GraphsLink PredictionReinforced Knowledge Distillation for Time Series Regression
As one of the most popular and effective methods in model compression, knowledge distillation (KD) attempts to transfer knowledge from single or multiple large-scale networks (i.e., Teachers) to a compact network (i.e., …
Knowledge DistillationModel CompressionregressionTime Series+1