DemiNet: Dependency-Aware Multi-Interest Network with Self-Supervised Graph Learning for Click-Through Rate Prediction
In this paper, we propose a novel model named DemiNet (short for DEpendency-Aware Multi-Interest Network) to address the above two issues. To be specific, we first consider various dependency types between item nodes and perform dependency-aware heterogeneous attention for denoising and obtaining accurate sequence item representations. Secondly, for multiple interests extraction, multi-head attention is conducted on top of the graph embedding. To filter out noisy inter-item correlations and enhance the robustness of extracted interests, self-supervised interest learning is introduced to the above two steps. Thirdly, to aggregate the multiple interests, interest experts corresponding to different interest routes give rating scores respectively, while a specialized network assigns the confidence of each score. Experimental results on three real-world datasets demonstrate that the proposed DemiNet significantly improves the overall recommendation performance over several state-of-the-art baselines. Further studies verify the efficacy and interpretability benefits brought by the fine-grained user interest modeling.
Code (0)
등록된 구현이 없습니다.
Tasks
Click-Through Rate PredictionDenoisingGraph EmbeddingGraph LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Source Dependency-Aware Transformer with Supervised Self-Attention
Recently, Transformer has achieved the state-of-the-art performance on many machine translation tasks. However, without syntax knowledge explicitly considered in the encoder, incorrect context information that violates t…
Machine TranslationTranslationSession-based Social and Dependency-aware Software Recommendation
With the increase of complexity of modern software, social collaborative coding and reuse of open source software packages become more and more popular, which thus greatly enhances the development efficiency and software…
Graph AttentionRecommendation SystemsEnhancing Machine Translation with Dependency-Aware Self-Attention
Most neural machine translation models only rely on pairs of parallel sentences, assuming syntactic information is automatically learned by an attention mechanism. In this work, we investigate different approaches to inc…
Machine TranslationTranslationEntity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences
Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to ca…
PositionRelationRelation ExtractionRelation Prediction+1Deps-SAN: Neural Machine Translation with Dependency-Scaled Self-Attention Network
Syntax knowledge contributes its powerful strength in Neural machine translation (NMT) tasks. Early NMT works supposed that syntax details can be automatically learned from numerous texts via attention networks. However,…
Machine TranslationNMTTranslation