Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights

2023-05-19 · Ruyu Li, Wenhao Deng, Yu Cheng, Zheng Yuan, JiaQi Zhang, Fajie Yuan

Text-based collaborative filtering (TCF) has become the mainstream approach for text and news recommendation, utilizing text encoders, also known as language models (LMs), to represent items. However, existing TCF models primarily focus on using small or medium-sized LMs. It remains uncertain what impact replacing the item encoder with one of the largest and most powerful LMs, such as the 175-billion parameter GPT-3 model, would have on recommendation performance. Can we expect unprecedented results? To this end, we conduct an extensive series of experiments aimed at exploring the performance limits of the TCF paradigm. Specifically, we increase the size of item encoders from one hundred million to one hundred billion to reveal the scaling limits of the TCF paradigm. We then examine whether these extremely large LMs could enable a universal item representation for the recommendation task. Furthermore, we compare the performance of the TCF paradigm utilizing the most powerful LMs to the currently dominant ID embedding-based paradigm and investigate the transferability of this TCF paradigm. Finally, we compare TCF with the recently popularized prompt-based recommendation using ChatGPT. Our research findings have not only yielded positive results but also uncovered some surprising and previously unknown negative outcomes, which can inspire deeper reflection and innovative thinking regarding text-based recommender systems. Codes and datasets will be released for further research.

📄 PDF Abstract BibTeX arXiv:2305.11700

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringNews RecommendationRecommendation Systems

Methods 이 논문이 사용한 방법론

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Attention 설명 없음

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Multi-Head Attention 설명 없음

Geometric Collaborative Filtering with Convergence

2024-10-04 · Hisham Husain, Julien Monteil

Latent variable collaborative filtering methods have been a standard approach to modelling user-click interactions due to their simplicity and effectiveness. However, there is limited work on analyzing the mathematical p…

Collaborative Filtering

Collaborative Filtering vs. Content-Based Filtering: differences and similarities

2019-12-18 · Rafael Glauber, Angelo Loula

Recommendation Systems (SR) suggest items exploring user preferences, helping them with the information overload problem. Two approaches to SR have received more prominence, Collaborative Filtering, and Content-Based Fil…

Collaborative Filtering Recommendation Systems

Collaborative Filtering Ensemble for Personalized Name Recommendation

2014-07-16 · Bernat Coma-Puig, Ernesto Diaz-Aviles, Wolfgang Nejdl

Out of thousands of names to choose from, picking the right one for your child is a daunting task. In this work, our objective is to help parents making an informed decision while choosing a name for their baby. We follo…

Collaborative Filtering Recommendation Systems

Neural Collaborative Filtering Bandits via Meta Learning

2022-01-31 · Yikun Ban, Yunzhe Qi, Tianxin Wei, Jingrui He

Contextual multi-armed bandits provide powerful tools to solve the exploitation-exploration dilemma in decision making, with direct applications in the personalized recommendation. In fact, collaborative effects among us…

Collaborative Filtering Decision Making Meta-Learning Multi-Armed Bandits

A Survey on Deep Neural Networks in Collaborative Filtering Recommendation Systems

2024-12-02 · Pang Li, Shahrul Azman Mohd Noah, Hafiz Mohd Sarim

This survey provides an examination of the use of Deep Neural Networks (DNN) in Collaborative Filtering (CF) recommendation systems. As the digital world increasingly relies on data-driven approaches, traditional CF tech…

Collaborative Filtering Recommendation Systems Survey