Explicit User Manipulation in Reinforcement Learning Based Recommender Systems

2022-03-20 · Matthew Sparr

Recommender systems are highly prevalent in the modern world due to their value to both users and platforms and services that employ them. Generally, they can improve the user experience and help to increase satisfaction, but they do not come without risks. One such risk is that of their effect on users and their ability to play an active role in shaping user preferences. This risk is more significant for reinforcement learning based recommender systems. These are capable of learning for instance, how recommended content shown to a user today may tamper that user's preference for other content recommended in the future. Reinforcement learning based recommendation systems can thus implicitly learn to influence users if that means maximizing clicks, engagement, or consumption. On social news and media platforms, in particular, this type of behavior is cause for alarm. Social media undoubtedly plays a role in public opinion and has been shown to be a contributing factor to increased political polarization. Recommender systems on such platforms, therefore, have great potential to influence users in undesirable ways. However, it may also be possible for this form of manipulation to be used intentionally. With advancements in political opinion dynamics modeling and larger collections of user data, explicit user manipulation in which the beliefs and opinions of users are tailored towards a certain end emerges as a significant concern in reinforcement learning based recommender systems.

📄 PDF Abstract BibTeX arXiv:2203.10629

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Solutions to preference manipulation in recommender systems require knowledge of meta-preferences

2022-09-14 · Hal Ashton, Matija Franklin

Iterative machine learning algorithms used to power recommender systems often change people's preferences by trying to learn them. Further a recommender can better predict what a user will do by making its users more pre…

Recommendation Systems

Understanding or Manipulation: Rethinking Online Performance Gains of Modern Recommender Systems

2022-10-11 · Zhengbang Zhu, Rongjun Qin, JunJie Huang, Xinyi Dai 외

Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are …

Benchmarking Recommendation Systems Sequential Recommendation

LLM-Powered User Simulator for Recommender System

2024-12-22 · Zijian Zhang, Shuchang Liu, Ziru Liu, Rui Zhong 외

User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. How…

Recommendation Systems reinforcement-learning Reinforcement Learning

Modeling Recommender Ecosystems: Research Challenges at the Intersection of Mechanism Design, Reinforcement Learning and Generative Models

2023-09-08 · Craig Boutilier, Martin Mladenov, Guy Tennenholtz

Modern recommender systems lie at the heart of complex ecosystems that couple the behavior of users, content providers, advertisers, and other actors. Despite this, the focus of the majority of recommender research -- an…