A Bag of Tricks for Scaling CPU-based Deep FFMs to more than 300m Predictions per Second
Field-aware Factorization Machines (FFMs) have emerged as a powerful model for click-through rate prediction, particularly excelling in capturing complex feature interactions. In this work, we present an in-depth analysis of our in-house, Rust-based Deep FFM implementation, and detail its deployment on a CPU-only, multi-data-center scale. We overview key optimizations devised for both training and inference, demonstrated by previously unpublished benchmark results in efficient model search and online training. Further, we detail an in-house weight quantization that resulted in more than an order of magnitude reduction in bandwidth footprint related to weight transfers across data-centres. We disclose the engine and associated techniques under an open-source license to contribute to the broader machine learning community. This paper showcases one of the first successful CPU-only deployments of Deep FFMs at such scale, marking a significant stride in practical, low-footprint click-through rate prediction methodologies.
Code (0)
등록된 구현이 없습니다.
Tasks
Click-Through Rate PredictionCPUQuantizationSimilar Papers 제목 키워드 기반
DiffMS: Diffusion Generation of Molecules Conditioned on Mass Spectra
Mass spectrometry plays a fundamental role in elucidating the structures of unknown molecules and subsequent scientific discoveries. One formulation of the structure elucidation task is the conditional de novo generation…
DecoderDe novo molecule generation from MS/MS spectrum (bonus chemical formulae)scientific discoveryField-aware factorization machines for CTR prediction
Click-through rate (CTR) prediction plays an important role in computational advertising. Models based on degree-2 polynomial mappings and factorization machines (FMs) are widely used for this task. Recently, a varian…
Click-Through Rate PredictionPredictionRecommendation SystemsSub-pixel face landmarks using heatmaps and a bag of tricks
Accurate face landmark localization is an essential part of face recognition, reconstruction and morphing. To accurately localize face landmarks, we present our heatmap regression approach. Each model consists of a Mobil…
Face AlignmentFace RecognitionPositionField-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising
Click-through rate (CTR) prediction is a critical task in online display advertising. The data involved in CTR prediction are typically multi-field categorical data, i.e., every feature is categorical and belongs to one …
Click-Through Rate PredictionPredictionTextual Backdoor Attacks Can Be More Harmful via Two Simple Tricks
Backdoor attacks are a kind of emergent security threat in deep learning. After being injected with a backdoor, a deep neural model will behave normally on standard inputs but give adversary-specified predictions once th…
Vocal Bursts Valence Prediction