paper-with-me

홈 › Papers

Enhancing Recommender Systems Using Textual Embeddings from Pre-trained Language Models

2025-03-24 · Ngoc Luyen Le, Marie-Hélène Abel

Recent advancements in language models and pre-trained language models like BERT and RoBERTa have revolutionized natural language processing, enabling a deeper understanding of human-like language. In this paper, we explore enhancing recommender systems using textual embeddings from pre-trained language models to address the limitations of traditional recommender systems that rely solely on explicit features from users, items, and user-item interactions. By transforming structured data into natural language representations, we generate high-dimensional embeddings that capture deeper semantic relationships between users, items, and contexts. Our experiments demonstrate that this approach significantly improves recommendation accuracy and relevance, resulting in more personalized and context-aware recommendations. The findings underscore the potential of PLMs to enhance the effectiveness of recommender systems.

📄 PDF Abstract BibTeX arXiv:2504.08746

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Enhancing Topic Extraction in Recommender Systems with Entropy Regularization

2023-06-12 · Xuefei Jiang, Dairui Liu, Ruihai Dong

In recent years, many recommender systems have utilized textual data for topic extraction to enhance interpretability. However, our findings reveal a noticeable deficiency in the coherence of keywords within topics, resu…

Recommendation SystemsWord Embeddings

Learning Decomposed Contextual Token Representations from Pretrained and Collaborative Signals for Generative Recommendation

2025-08-22 · Yifan Liu, Yaokun Liu, Zelin Li, Zhenrui Yue 외 arxiv

Recent advances in generative recommenders adopt a two-stage paradigm: items are first tokenized into semantic IDs using a pretrained tokenizer, and then large language models (LLMs) are trained to generate the next item…

Integrating Textual Embeddings from Contrastive Learning with Generative Recommender for Enhanced Personalization

2025-04-13 · Yijun Liu

Recent advances in recommender systems have highlighted the complementary strengths of generative modeling and pretrained language models. We propose a hybrid framework that augments the Hierarchical Sequential Transduct…

Contrastive LearningRecommendation Systems

EncodeRec: An Embedding Backbone for Recommendation Systems

2026-01-15 · Guy Hadad, Neomi Rabaev, Bracha Shapira arxiv

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured…

Sequential RecommendationRecommendation Systems

Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning

2023-02-09 · Nuofan Xu, Chenhui Hu

Pretrained Language Models (PLM) have been greatly successful on a board range of natural language processing (NLP) tasks. However, it has just started being applied to the domain of recommendation systems. Traditional r…

Language ModelingLanguage ModellingRecommendation Systems