Multi-Layer Ranking with Large Language Models for News Source Recommendation
To seek reliable information sources for news events, we introduce a novel task of expert recommendation, which aims to identify trustworthy sources based on their previously quoted statements. To achieve this, we built a novel dataset, called NewsQuote, consisting of 23,571 quote-speaker pairs sourced from a collection of news articles. We formulate the recommendation task as the retrieval of experts based on their likelihood of being associated with a given query. We also propose a multi-layer ranking framework employing Large Language Models to improve the recommendation performance. Our results show that employing an in-context learning based LLM ranker and a multi-layer ranking-based filter significantly improve both the predictive quality and behavioural quality of the recommender system.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesIn-Context LearningRecommendation SystemsRetrievalSimilar Papers 제목 키워드 기반
LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendation
Online fake news moderation now faces a new challenge brought by the malicious use of large language models (LLMs) in fake news production. Though existing works have shown LLM-generated fake news is hard to detect from …
News RecommendationRecommendation SystemsMediaRank: Computational Ranking of Online News Sources
In the recent political climate, the topic of news quality has drawn attention both from the public and the academic communities. The growing distrust of traditional news media makes it harder to find a common base of ac…
Multi-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search
Despite substantial interest in applications of neural networks to information retrieval, neural ranking models have only been applied to standard ad hoc retrieval tasks over web pages and newswire documents. This paper …
Information RetrievalRetrievalUni-FedRec: A Unified Privacy-Preserving News Recommendation Framework for Model Training and Online Serving
News recommendation is important for personalized online news services. Most existing news recommendation methods rely on centrally stored user behavior data to both train models offline and provide online recommendation…
News GenerationNews RecommendationPrivacy PreservingRecommendation SystemsTwo Birds with One Stone: Unified Model Learning for Both Recall and Ranking in News Recommendation
Recall and ranking are two critical steps in personalized news recommendation. Most existing news recommender systems conduct personalized news recall and ranking separately with different models. However, maintaining mu…
News RecommendationRecommendation Systems