Collaborative Filtering and the Missing at Random Assumption
Rating prediction is an important application, and a popular research topic in collaborative filtering. However, both the validity of learning algorithms, and the validity of standard testing procedures rest on the assumption that missing ratings are missing at random (MAR). In this paper we present the results of a user study in which we collect a random sample of ratings from current users of an online radio service. An analysis of the rating data collected in the study shows that the sample of random ratings has markedly different properties than ratings of user-selected songs. When asked to report on their own rating behaviour, a large number of users indicate they believe their opinion of a song does affect whether they choose to rate that song, a violation of the MAR condition. Finally, we present experimental results showing that incorporating an explicit model of the missing data mechanism can lead to significant improvements in prediction performance on the random sample of ratings.
Code (1)
Tasks
Collaborative FilteringSimilar Papers 제목 키워드 기반
One-class Collaborative Filtering with Random Graphs: Annotated Version
The bane of one-class collaborative filtering is interpreting and modelling the latent signal from the missing class. In this paper we present a novel Bayesian generative model for implicit collaborative filtering. It fo…
Collaborative FilteringVariational InferenceDynamic Matrix Factorization with Priors on Unknown Values
Advanced and effective collaborative filtering methods based on explicit feedback assume that unknown ratings do not follow the same model as the observed ones (\emph{not missing at random}). In this work, we build on th…
Collaborative FilteringAutomatic Feature Induction for Stagewise Collaborative Filtering
Recent approaches to collaborative filtering have concentrated on estimating an algebraic or statistical model, and using the model for predicting missing ratings. In this paper we observe that different models have rela…
Collaborative FilteringMissing Value Imputation With Unsupervised Backpropagation
Many data mining and data analysis techniques operate on dense matrices or complete tables of data. Real-world data sets, however, often contain unknown values. Even many classification algorithms that are designed to op…
Collaborative FilteringGeneral ClassificationImputationMissing ValuesLiRa: A New Likelihood-Based Similarity Score for Collaborative Filtering
Recommender system data presents unique challenges to the data mining, machine learning, and algorithms communities. The high missing data rate, in combination with the large scale and high dimensionality that is typical…
Collaborative FilteringMissing ValuesRecommendation Systems