paper-with-me

홈 › Papers

Enhancing Scalability in Recommender Systems through Lottery Ticket Hypothesis and Knowledge Distillation-based Neural Network Pruning

2024-01-19 · Rajaram R, Manoj Bharadhwaj, Vasan VS, Nargis Pervin

This study introduces an innovative approach aimed at the efficient pruning of neural networks, with a particular focus on their deployment on edge devices. Our method involves the integration of the Lottery Ticket Hypothesis (LTH) with the Knowledge Distillation (KD) framework, resulting in the formulation of three distinct pruning models. These models have been developed to address scalability issue in recommender systems, whereby the complexities of deep learning models have hindered their practical deployment. With judicious application of the pruning techniques, we effectively curtail the power consumption and model dimensions without compromising on accuracy. Empirical evaluation has been performed using two real world datasets from diverse domains against two baselines. Gratifyingly, our approaches yielded a GPU computation-power reduction of up to 66.67%. Notably, our study contributes to the field of recommendation system by pioneering the application of LTH and KD.

📄 PDF Abstract BibTeX arXiv:2401.10484

Code (0)

등록된 구현이 없습니다.

Tasks

GPUKnowledge DistillationNetwork PruningRecommendation Systems

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Exploring Lottery Ticket Hypothesis in Media Recommender Systems

2021-08-02 · Yanfang Wang, Yongduo Sui, Xiang Wang, Zhenguang Liu 외

Media recommender systems aim to capture users' preferences and provide precise personalized recommendation of media content. There are two critical components in the common paradigm of modern recommender models: (1) rep…

Recommendation SystemsRepresentation Learning

The Benchmark Lottery

2021-07-14 · Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao 외

The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes the notion of "a benchmark lottery" tha…

BenchmarkingBIG-bench Machine LearningInformation RetrievalRecommendation Systems+1

Linear-Time Graph Neural Networks for Scalable Recommendations

2024-02-21 · Jiahao Zhang, Rui Xue, Wenqi Fan, Xin Xu 외

In an era of information explosion, recommender systems are vital tools to deliver personalized recommendations for users. The key of recommender systems is to forecast users' future behaviors based on previous user-item…

Graph Neural NetworkRecommendation Systems

Communication-Efficient and Personalized Federated Lottery Ticket Learning

2021-04-26 · Sejin Seo, Seung-Woo Ko, Jihong Park, Seong-Lyun Kim 외

The lottery ticket hypothesis (LTH) claims that a deep neural network (i.e., ground network) contains a number of subnetworks (i.e., winning tickets), each of which exhibiting identically accurate inference capability as…

Federated LearningMulti-Task Learning

Block based Singular Value Decomposition approach to matrix factorization for recommender systems

2019-07-17 · Prasad Bhavana, Vikas Kumar, Vineet Padmanabhan

With the abundance of data in recent years, interesting challenges are posed in the area of recommender systems. Producing high quality recommendations with scalability and performance is the need of the hour. Singular V…

GPURecommendation Systems