Empowering News Recommendation with Pre-trained Language Models
Personalized news recommendation is an essential technique for online news services. News articles usually contain rich textual content, and accurate news modeling is important for personalized news recommendation. Existing news recommendation methods mainly model news texts based on traditional text modeling methods, which is not optimal for mining the deep semantic information in news texts. Pre-trained language models (PLMs) are powerful for natural language understanding, which has the potential for better news modeling. However, there is no public report that show PLMs have been applied to news recommendation. In this paper, we report our work on exploiting pre-trained language models to empower news recommendation. Offline experimental results on both monolingual and multilingual news recommendation datasets show that leveraging PLMs for news modeling can effectively improve the performance of news recommendation. Our PLM-empowered news recommendation models have been deployed to the Microsoft News platform, and achieved significant gains in terms of both click and pageview in both English-speaking and global markets.
Code (1)
Tasks
ArticlesNatural Language UnderstandingNews RecommendationSimilar Papers 제목 키워드 기반
MIND: A Large-scale Dataset for News Recommendation
News recommendation is an important technique for personalized news service. Compared with product and movie recommendations which have been comprehensively studied, the research on news recommendation is much more limit…
ArticlesNews RecommendationPBNR: Prompt-based News Recommender System
Online news platforms often use personalized news recommendation methods to help users discover articles that align with their interests. These methods typically predict a matching score between a user and a candidate ar…
ArticlesLanguage ModelingLanguage ModellingLarge Language Model+4A Preliminary Study of ChatGPT on News Recommendation: Personalization, Provider Fairness, Fake News
Online news platforms commonly employ personalized news recommendation methods to assist users in discovering interesting articles, and many previous works have utilized language model techniques to capture user interest…
ArticlesFairnessFake News DetectionLanguage Modelling+1CherryRec: Enhancing News Recommendation Quality via LLM-driven Framework
Large Language Models (LLMs) have achieved remarkable progress in language understanding and generation. Custom LLMs leveraging textual features have been applied to recommendation systems, demonstrating improvements acr…
Movie RecommendationNews RecommendationRecommendation SystemsTiny-NewsRec: Effective and Efficient PLM-based News Recommendation
News recommendation is a widely adopted technique to provide personalized news feeds for the user. Recently, pre-trained language models (PLMs) have demonstrated the great capability of natural language understanding and…
Knowledge DistillationNatural Language UnderstandingNews Recommendation