Discordance Minimization-based Imputation Algorithms for Missing Values in Rating Data
Ratings are frequently used to evaluate and compare subjects in various applications, from education to healthcare, because ratings provide succinct yet credible measures for comparing subjects. However, when multiple rating lists are combined or considered together, subjects often have missing ratings, because most rating lists do not rate every subject in the combined list. In this study, we propose analyses on missing value patterns using six real-world data sets in various applications, as well as the conditions for applicability of imputation algorithms. Based on the special structures and properties derived from the analyses, we propose optimization models and algorithms that minimize the total rating discordance across rating providers to impute missing ratings in the combined rating lists, using only the known rating information. The total rating discordance is defined as the sum of the pairwise discordance metric, which can be written as a quadratic function. Computational experiments based on real-world and synthetic rating data sets show that the proposed methods outperform the state-of-the-art general imputation methods in the literature in terms of imputation accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationMissing ValuesSimilar Papers 제목 키워드 기반
On the consistency of supervised learning with missing values
In many application settings, the data have missing entries which make analysis challenging. An abundant literature addresses missing values in an inferential framework: estimating parameters and their variance from inco…
AttributeImputationMissing ValuesNo imputation without representation
By filling in missing values in datasets, imputation allows these datasets to be used with algorithms that cannot handle missing values by themselves. However, missing values may in principle contribute useful informatio…
AttributeImputationMissing ValuesOn the Performance of Imputation Techniques for Missing Values on Healthcare Datasets
Missing values or data is one popular characteristic of real-world datasets, especially healthcare data. This could be frustrating when using machine learning algorithms on such datasets, simply because most machine lear…
feature selectionImputationMissing ValuesDo We Really Need Imputation in AutoML Predictive Modeling?
Numerous real-world data contain missing values, while in contrast, most Machine Learning (ML) algorithms assume complete datasets. For this reason, several imputation algorithms have been proposed to predict and fill in…
Automatic Machine Learning Model SelectionAutoMLBinary Classificationfeature selection+2Iterative missing value imputation based on feature importance
Many datasets suffer from missing values due to various reasons,which not only increases the processing difficulty of related tasks but also reduces the accuracy of classification. To address this problem, the mainstream…
Feature ImportanceImputationMatrix CompletionMissing Values