Convolutional Quantum-Like Language Model with Mutual-Attention for Product Rating Prediction
Recommender systems are designed to help mitigate information overload users experience during online shopping. Recent work explores neural language models to learn user and item representations from user reviews and combines such representations with rating information. Most existing convolutional-based neural models take pooling immediately after convolution and loses the interaction information between the latent dimension of convolutional feature vectors along the way. Moreover, these models usually take all feature vectors at higher levels as equal and do not take into consideration that some features are more relevant to this specific user-item context. To bridge these gaps, this paper proposes a convolutional quantum-like language model with mutual-attention for rating prediction (ConQAR). By introducing a quantum-like density matrix layer, interactions between latent dimensions of convolutional feature vectors are well captured. With the attention weights learned from the mutual-attention layer, final representations of a user and an item absorb information from both itself and its counterparts for making rating prediction. Experiments on two large datasets show that our model outperforms multiple state-of-the-art CNN-based models. We also perform an ablation test to analyze the independent effects of the two components of our model. Moreover, we conduct a case study and present visualizations of the quantum probabilistic distributions in one user and one item review document to show that the learned distributions capture meaningful information about this user and item, and can be potentially used as textual profiling of the user and item.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multilingual Machine Translation with Quantum Encoder Decoder Attention-based Convolutional Variational Circuits
Cloud-based multilingual translation services like Google Translate and Microsoft Translator achieve state-of-the-art translation capabilities. These services inherently use large multilingual language models such as GRU…
DecoderMachine TranslationTranslationQIXAI: A Quantum-Inspired Framework for Enhancing Classical and Quantum Model Transparency and Understanding
The impressive performance of deep learning models, particularly Convolutional Neural Networks (CNNs), is often hindered by their lack of interpretability, rendering them "black boxes." This opacity raises concerns in cr…
Feature ImportanceTime Series AnalysisMutual Information Maximizing Quantum Generative Adversarial Network and Its Applications in Finance
One of the most promising applications in the era of NISQ (Noisy Intermediate-Scale Quantum) computing is quantum machine learning. Quantum machine learning offers significant quantum advantages over classical machine le…
Generative Adversarial NetworkImage GenerationQuantum Machine LearningLattice Convolutional Networks for Learning Ground States of Quantum Many-Body Systems
Deep learning methods have been shown to be effective in representing ground-state wave functions of quantum many-body systems. Existing methods use convolutional neural networks (CNNs) for square lattices due to their i…
Graph Neural NetworkGraph Neural Networks on Quantum Computers
Graph Neural Networks (GNNs) are powerful machine learning models that excel at analyzing structured data represented as graphs, demonstrating remarkable performance in applications like social network analysis and recom…
Graph AttentionGraph Neural NetworkQuantum Machine LearningRecommendation Systems