Testing Deep Learning Recommender Systems Models on Synthetic GAN-Generated Datasets
The published method Generative Adversarial Networks for Recommender Systems (GANRS) allows generating data sets for collaborative filtering recommendation systems. The GANRS source code is available along with a representative set of generated datasets. We have tested the GANRS method by creating multiple synthetic datasets from three different real datasets taken as a source. Experiments include variations in the number of users in the synthetic datasets, as well as a different number of samples. We have also selected six state-of-the-art collaborative filtering deep learning models to test both their comparative performance and the GANRS method. The results show a consistent behavior of the generated datasets compared to the source ones; particularly, in the obtained values and trends of the precision and recall quality measures. The tested deep learning models have also performed as expected on all synthetic datasets, making it possible to compare the results with those obtained from the real source data. Future work is proposed, including different cold start scenarios, unbalanced data, and demographic fairness.
Code (0)
등록된 구현이 없습니다.
Tasks
Collaborative FilteringDeep LearningFairnessRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Creating Synthetic Datasets for Collaborative Filtering Recommender Systems using Generative Adversarial Networks
Research and education in machine learning needs diverse, representative, and open datasets that contain sufficient samples to handle the necessary training, validation, and testing tasks. Currently, the Recommender Syst…
Collaborative FilteringGenerative Adversarial NetworkRecommendation SystemsGenerating Diverse Synthetic Datasets for Evaluation of Real-life Recommender Systems
Synthetic datasets are important for evaluating and testing machine learning models. When evaluating real-life recommender systems, high-dimensional categorical (and sparse) datasets are often considered. Unfortunately, …
AutoMLBenchmarkingFrictionRecommendation SystemsEffects of Using Synthetic Data on Deep Recommender Models' Performance
Recommender systems are essential for enhancing user experiences by suggesting items based on individual preferences. However, these systems frequently face the challenge of data imbalance, characterized by a predominanc…
Data AugmentationRecommendation SystemsSynthetic Data GenerationSynthetic Data-Based Simulators for Recommender Systems: A Survey
This survey aims at providing a comprehensive overview of the recent trends in the field of modeling and simulation (M&S) of interactions between users and recommender systems and applications of the M&S to the performan…
Recommendation SystemsSurveyEvaluation of Synthetic Datasets for Conversational Recommender Systems
For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing pro…
DiversityRecommendation Systems