paper-with-me

홈 › Papers

DemiNet: Dependency-Aware Multi-Interest Network with Self-Supervised Graph Learning for Click-Through Rate Prediction

2021-09-26 · Yule Wang, Qiang Luo, Yue Ding, Yunzhe Li, Dong Wang, Hongbo Deng

In this paper, we propose a novel model named DemiNet (short for DEpendency-Aware Multi-Interest Network) to address the above two issues. To be specific, we first consider various dependency types between item nodes and perform dependency-aware heterogeneous attention for denoising and obtaining accurate sequence item representations. Secondly, for multiple interests extraction, multi-head attention is conducted on top of the graph embedding. To filter out noisy inter-item correlations and enhance the robustness of extracted interests, self-supervised interest learning is introduced to the above two steps. Thirdly, to aggregate the multiple interests, interest experts corresponding to different interest routes give rating scores respectively, while a specialized network assigns the confidence of each score. Experimental results on three real-world datasets demonstrate that the proposed DemiNet significantly improves the overall recommendation performance over several state-of-the-art baselines. Further studies verify the efficacy and interpretability benefits brought by the fine-grained user interest modeling.

📄 PDF Abstract BibTeX arXiv:2109.12512

Code (0)

등록된 구현이 없습니다.

Tasks

Click-Through Rate PredictionDenoisingGraph EmbeddingGraph Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Source Dependency-Aware Transformer with Supervised Self-Attention

2019-09-05 · Chengyi Wang, Shuangzhi Wu, Shujie Liu

Recently, Transformer has achieved the state-of-the-art performance on many machine translation tasks. However, without syntax knowledge explicitly considered in the encoder, incorrect context information that violates t…

Machine TranslationTranslation

Session-based Social and Dependency-aware Software Recommendation

2021-03-10 · Dengcheng Yan, Tianyi Tang, Wenxin Xie, Yiwen Zhang 외

With the increase of complexity of modern software, social collaborative coding and reuse of open source software packages become more and more popular, which thus greatly enhances the development efficiency and software…

Graph AttentionRecommendation Systems

Enhancing Machine Translation with Dependency-Aware Self-Attention

2019-09-06 · ACL 2020 6 · Emanuele Bugliarello, Naoaki Okazaki

Most neural machine translation models only rely on pairs of parallel sentences, assuming syntactic information is automatically learned by an attention mechanism. In this work, we investigate different approaches to inc…

Machine TranslationTranslation

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

2024-09-15 · Xin Wang, Xinyi Bai

Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to ca…

PositionRelationRelation ExtractionRelation Prediction+1

Deps-SAN: Neural Machine Translation with Dependency-Scaled Self-Attention Network

2021-11-23 · Ru Peng, Nankai Lin, Yi Fang, Shengyi Jiang 외

Syntax knowledge contributes its powerful strength in Neural machine translation (NMT) tasks. Early NMT works supposed that syntax details can be automatically learned from numerous texts via attention networks. However,…

Machine TranslationNMTTranslation