Ad-Rec: Advanced Feature Interactions to Address Covariate-Shifts in Recommendation Networks
Recommendation models are vital in delivering personalized user experiences by leveraging the correlation between multiple input features. However, deep learning-based recommendation models often face challenges due to evolving user behaviour and item features, leading to covariate shifts. Effective cross-feature learning is crucial to handle data distribution drift and adapting to changing user behaviour. Traditional feature interaction techniques have limitations in achieving optimal performance in this context. This work introduces Ad-Rec, an advanced network that leverages feature interaction techniques to address covariate shifts. This helps eliminate irrelevant interactions in recommendation tasks. Ad-Rec leverages masked transformers to enable the learning of higher-order cross-features while mitigating the impact of data distribution drift. Our approach improves model quality, accelerates convergence, and reduces training time, as measured by the Area Under Curve (AUC) metric. We demonstrate the scalability of Ad-Rec and its ability to achieve superior model quality through comprehensive ablation studies.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Algorithmic Fairness Generalization under Covariate and Dependence Shifts Simultaneously
The endeavor to preserve the generalization of a fair and invariant classifier across domains, especially in the presence of distribution shifts, becomes a significant and intricate challenge in machine learning. In resp…
Domain GeneralizationFairnessNavigateMitigating Graph Covariate Shift via Score-based Out-of-distribution Augmentation
Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of…
Graph GenerationGraph LearningGDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models
Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs pri…
Out of Distribution (OOD) DetectionEgo4OOD: Rethinking Egocentric Video Domain Generalization via Covariate Shift Scoring
Egocentric video action recognition under domain shifts remains challenging due to large intra-class spatio-temporal variability, long-tailed feature distributions, and strong correlations between actions and environment…
Domain GeneralizationBinary ClassificationAction RecognitionUnleashing the Power of Graph Data Augmentation on Covariate Distribution Shift
The issue of distribution shifts is emerging as a critical concern in graph representation learning. From the perspective of invariant learning and stable learning, a recently well-established paradigm for out-of-distrib…
Data AugmentationGraph ClassificationGraph Representation LearningOut-of-Distribution Generalization+1