UMEC: Unified model and embedding compression for efficient recommendation systems
The recommendation system (RS) plays an important role in the content recommendation and retrieval scenarios. The core part of the system is the Ranking neural network, which is usually a bottleneck of whole system performance during online inference. In this work, we propose a unified model and embedding compression (UMEC) framework to hammer an efficient neural network-based recommendation system. Our framework jointly learns input feature selection and neural network compression together, and solve them as an end-to-end resource-constrained optimization problem using ADMM. Our method outperforms other baselines in terms of neural network Flops, sparse embedding feature size and the number of sparse embedding features. We evaluate our method on the public benchmark of DLRM, trained over the Kaggle Criteo dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Efficient Neural Networkfeature selectionNeural Network CompressionRecommendation SystemsRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Saec: Similarity-Aware Embedding Compression in Recommendation Systems
Production recommendation systems rely on embedding methods to represent various features. An impeding challenge in practice is that the large embedding matrix incurs substantial memory footprint in serving as the number…
ClusteringRecommendation SystemsEmbedding Compression in Recommender Systems: A Survey
To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transfor…
Recommendation SystemsSurveyCompressed Concatenation of Small Embedding Models
Embedding models are central to dense retrieval, semantic search, and recommendation systems, but their size often makes them impractical to deploy in resource-constrained environments such as browsers or edge devices. W…
Representation LearningRecommendation SystemsEfficient On-Device Session-Based Recommendation
On-device session-based recommendation systems have been achieving increasing attention on account of the low energy/resource consumption and privacy protection while providing promising recommendation performance. To fi…
Knowledge DistillationModel CompressionRecommendation SystemsSession-Based Recommendations