Continual Transfer Learning for Cross-Domain Click-Through Rate Prediction at Taobao
As one of the largest e-commerce platforms in the world, Taobao's recommendation systems (RSs) serve the demands of shopping for hundreds of millions of customers. Click-Through Rate (CTR) prediction is a core component of the RS. One of the biggest characteristics in CTR prediction at Taobao is that there exist multiple recommendation domains where the scales of different domains vary significantly. Therefore, it is crucial to perform cross-domain CTR prediction to transfer knowledge from large domains to small domains to alleviate the data sparsity issue. However, existing cross-domain CTR prediction methods are proposed for static knowledge transfer, ignoring that all domains in real-world RSs are continually time-evolving. In light of this, we present a necessary but novel task named Continual Transfer Learning (CTL), which transfers knowledge from a time-evolving source domain to a time-evolving target domain. In this work, we propose a simple and effective CTL model called CTNet to solve the problem of continual cross-domain CTR prediction at Taobao, and CTNet can be trained efficiently. Particularly, CTNet considers an important characteristic in the industry that models has been continually well-trained for a very long time. So CTNet aims to fully utilize all the well-trained model parameters in both source domain and target domain to avoid losing historically acquired knowledge, and only needs incremental target domain data for training to guarantee efficiency. Extensive offline experiments and online A/B testing at Taobao demonstrate the efficiency and effectiveness of CTNet. CTNet is now deployed online in the recommender systems of Taobao, serving the main traffic of hundreds of millions of active users.
Code (0)
등록된 구현이 없습니다.
Tasks
Click-Through Rate PredictionPredictionRecommendation SystemsTransfer LearningSimilar Papers 제목 키워드 기반
QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain Search
In light of the success of the pre-trained language models (PLMs), continual pre-training of generic PLMs has been the paradigm of domain adaption. In this paper, we propose QUERT, A Continual Pre-trained Language Model …
Domain AdaptationLanguage ModelingLanguage ModellingPredictionUFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction
Click-Through Rate (CTR) prediction, which aims to estimate the probability of a user clicking on an item, is a key task in online advertising. Numerous existing CTR models concentrate on modeling the feature interaction…
Click-Through Rate PredictionKnowledge DistillationLanguage ModellingLarge Language ModelContinual Learning for CTR Prediction: A Hybrid Approach
Click-through rate(CTR) prediction is a core task in cost-per-click(CPC) advertising systems and has been studied extensively by machine learning practitioners. While many existing methods have been successfully deployed…
Click-Through Rate PredictionContinual LearningPredictionGIST: Cross-Domain Click-Through Rate Prediction via Guided Content-Behavior Distillation
Cross-domain Click-Through Rate prediction aims to tackle the data sparsity and the cold start problems in online advertising systems by transferring knowledge from source domains to a target domain. Most existing method…
Click-Through Rate PredictionTransfer LearningECAT: A Entire space Continual and Adaptive Transfer Learning Framework for Cross-Domain Recommendation
In industrial recommendation systems, there are several mini-apps designed to meet the diverse interests and needs of users. The sample space of them is merely a small subset of the entire space, making it challenging to…
Domain AdaptationKnowledge DistillationRecommendation SystemsTransfer Learning