Interface Design to Mitigate Inflation in Recommender Systems
Recommendation systems rely on user-provided data to learn about item quality and provide personalized recommendations. An implicit assumption when aggregating ratings into item quality is that ratings are strong indicators of item quality. In this work, we test this assumption using data collected from a music discovery application. Our study focuses on two factors that cause rating inflation: heterogeneous user rating behavior and the dynamics of personalized recommendations. We show that user rating behavior substantially varies by user, leading to item quality estimates that reflect the users who rated an item more than the item quality itself. Additionally, items that are more likely to be shown via personalized recommendations can experience a substantial increase in their exposure and potential bias toward them. To mitigate these effects, we analyze the results of a randomized controlled trial in which the rating interface was modified. The test resulted in a substantial improvement in user rating behavior and a reduction in item quality inflation. These findings highlight the importance of carefully considering the assumptions underlying recommendation systems and designing interfaces that encourage accurate rating behavior.
Code (1)
Tasks
Recommendation SystemsSimilar Papers 제목 키워드 기반
Toward Natural Language Mitigation Strategies for Cognitive Biases in Recommender Systems
Cognitive biases in the context of consuming online information filtered by recommender systems may lead to sub-optimal choices. One approach to mitigate such biases is through interface and interaction design. This surv…
Recommendation SystemsSurveyText GenerationAn Empirical Analysis on Transparent Algorithmic Exploration in Recommender Systems
All learning algorithms for recommendations face inevitable and critical trade-off between exploiting partial knowledge of a user's preferences for short-term satisfaction and exploring additional user preferences for lo…
Recommendation SystemsDynamic Adaptation of User Preferences and Results in a Destination Recommender System
Studying human factors has gained a lot of interest in recommender systems research recently. User experience plays a vital role in tourism recommender systems since user satisfaction is the main factor that guarantees t…
Recommendation SystemsImproving Recommender Systems Beyond the Algorithm
Recommender systems rely heavily on the predictive accuracy of the learning algorithm. Most work on improving accuracy has focused on the learning algorithm itself. We argue that this algorithmic focus is myopic. In part…
Recommendation SystemsMulti-Step Critiquing User Interface for Recommender Systems
Recommendations with personalized explanations have been shown to increase user trust and perceived quality and help users make better decisions. Moreover, such explanations allow users to provide feedback by critiquing …
Recommendation Systems