Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction
Click-through rate (CTR) prediction, whose goal is to predict the probability of the user to click on an item, has become increasingly significant in the recommender systems. Recently, some deep learning models with the ability to automatically extract the user interest from his/her behaviors have achieved great success. In these work, the attention mechanism is used to select the user interested items in historical behaviors, improving the performance of the CTR predictor. Normally, these attentive modules can be jointly trained with the base predictor by using gradient descents. In this paper, we regard user interest modeling as a feature selection problem, which we call user interest selection. For such a problem, we propose a novel approach under the framework of the wrapper method, which is named Meta-Wrapper. More specifically, we use a differentiable module as our wrapping operator and then recast its learning problem as a continuous bilevel optimization. Moreover, we use a meta-learning algorithm to solve the optimization and theoretically prove its convergence. Meanwhile, we also provide theoretical analysis to show that our proposed method 1) efficiencies the wrapper-based feature selection, and 2) achieves better resistance to overfitting. Finally, extensive experiments on three public datasets manifest the superiority of our method in boosting the performance of CTR prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilevel OptimizationClick-Through Rate Predictionfeature selectionMeta-LearningRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MINT: A wrapper to make multi-modal and multi-image AI models interactive
During the diagnostic process, doctors incorporate multimodal information including imaging and the medical history - and similarly medical AI development has increasingly become multimodal. In this paper we tackle a mor…
DiagnosticDisease PredictionPerceptual Video Compression with Neural Wrapping
Standard video codecs are rate-distortion optimization machines, where distortion is typically quantified using PSNR versus the source. However, it is now widely accepted that increasing PSNR does not necessarily tra…
MS-SSIMSSIMVideo CompressionEpistemic Wrapping for Uncertainty Quantification
Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improvin…
Uncertainty QuantificationNormalization Equivariance for Arbitrary Backbones, with Application to Image Denoising
Normalization Equivariance (NE) is a structural prior that improves robustness to distribution shift in image-to-image tasks. A function $f$ is normalization equivariant iff $f(a y + b\mathbf{1}) = a f(y) + b\mathbf{1}$ …
Image DenoisingEvoGrad: Metaheuristics in a Differentiable Wonderland
Differentiable programming has revolutionised optimisation by enabling efficient gradient-based training of complex models, such as Deep Neural Networks (NNs) with billions and trillions of parameters. However, tradition…