DumbleDR: Predicting User Preferences of Dimensionality Reduction Projection Quality
A plethora of dimensionality reduction techniques have emerged over the past decades, leaving researchers and analysts with a wide variety of choices for reducing their data, all the more so given some techniques come with additional parametrization (e.g. t-SNE, UMAP, etc.). Recent studies are showing that people often use dimensionality reduction as a black-box regardless of the specific properties the method itself preserves. Hence, evaluating and comparing 2D projections is usually qualitatively decided, by setting projections side-by-side and letting human judgment decide which projection is the best. In this work, we propose a quantitative way of evaluating projections, that nonetheless places human perception at the center. We run a comparative study, where we ask people to select 'good' and 'misleading' views between scatterplots of low-level projections of image datasets, simulating the way people usually select projections. We use the study data as labels for a set of quality metrics whose purpose is to discover and quantify what exactly people are looking for when deciding between projections. With this proxy for human judgments, we use it to rank projections on new datasets, explain why they are relevant, and quantify the degree of subjectivity in projections selected.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionSimilar Papers 제목 키워드 기반
Recurrent Neural Networks for Long and Short-Term Sequential Recommendation
Recommender systems objectives can be broadly characterized as modeling user preferences over short-or long-term time horizon. A large body of previous research studied long-term recommendation through dimensionality red…
Dimensionality ReductionRecommendation SystemsSequential RecommendationSession-Based RecommendationsAn Item-Based Collaborative Filtering using Dimensionality Reduction Techniques on Mahout Framework
Collaborative Filtering is the most widely used prediction technique in Recommendation System. Most of the current CF recommender systems maintains single criteria user rating in user item matrix. However, recent studies…
Collaborative FilteringDimensionality ReductionPredictionRecommendation SystemsCollaborative Gaussian Processes for Preference Learning
We present a new model based on Gaussian processes (GPs) for learning pairwise preferences expressed by multiple users. Inference is simplified by using a \emph{preference kernel} for GPs which allows us to combine super…
Active LearningDimensionality ReductionGaussian ProcessesDPDR: A novel machine learning method for the Decision Process for Dimensionality Reduction
This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and co…
BIG-bench Machine LearningDimensionality Reductionfeature selectionUnderstanding Bias in Perceiving Dimensionality Reduction Projections
Selecting the dimensionality reduction technique that faithfully represents the structure is essential for reliable visual communication and analytics. In reality, however, practitioners favor projections for other attra…
Dimensionality Reduction