paper-with-me

홈 › Papers

Online Learning for Recommendations at Grubhub

2021-07-15 · Alex Egg

We propose a method to easily modify existing offline Recommender Systems to run online using Transfer Learning. Online Learning for Recommender Systems has two main advantages: quality and scale. Like many Machine Learning algorithms in production if not regularly retrained will suffer from Concept Drift. A policy that is updated frequently online can adapt to drift faster than a batch system. This is especially true for user-interaction systems like recommenders where the underlying distribution can shift drastically to follow user behaviour. As a platform grows rapidly like Grubhub, the cost of running batch training jobs becomes material. A shift from stateless batch learning offline to stateful incremental learning online can recover, for example, at Grubhub, up to a 45x cost savings and a +20% metrics increase. There are a few challenges to overcome with the transition to online stateful learning, namely convergence, non-stationary embeddings and off-policy evaluation, which we explore from our experiences running this system in production.

📄 PDF Abstract BibTeX arXiv:2107.07106

Code (0)

등록된 구현이 없습니다.

Tasks

Incremental LearningOff-policy evaluationRecommendation SystemsTransfer Learning

Similar Papers 제목 키워드 기반

The Informational Role of Online Recommendations: Evidence from a Field Experiment

2022-11-25 · Guy Aridor, Duarte Goncalves, Daniel Kluver, Ruoyan Kong 외

We conduct a field experiment on a movie-recommendation platform to investigate whether and how online recommendations influence consumption choices. Using a within-subjects design, our experiment measures the causal eff…

Experimental DesignMovie RecommendationRecommendation Systems

Online Evaluations for Everyone: Mr. DLib's Living Lab for Scholarly Recommendations

2018-07-19 · Joeran Beel, Andrew Collins, Oliver Kopp, Linus W. Dietz 외

We introduce the first 'living lab' for scholarly recommender systems. This lab allows recommender-system researchers to conduct online evaluations of their novel algorithms for scholarly recommendations, i.e., recommend…

ManagementRecommendation Systems

Online Evaluation of Text-to-sign Translation by Deaf End Users: Some Methodological Recommendations (short paper)

2021-08-01 · MTSummit 2021 8 · Floris Roelofsen, Lyke Esselink, Shani Mende-Gillings, Maartje De Meulder 외

We present a number of methodological recommendations concerning the online evaluation of avatars for text-to-sign translation, focusing on the structure, format and length of the questionnaire, as well as methods for el…

Translation

What Drives Readership? An Online Study on User Interface Types and Popularity Bias Mitigation in News Article Recommendations

2021-11-29 · Emanuel Lacic, Leon Fadljevic, Franz Weissenboeck, Stefanie Lindstaedt 외

Personalized news recommender systems support readers in finding the right and relevant articles in online news platforms. In this paper, we discuss the introduction of personalized, content-based news recommendations on…

ArticlesRecommendation Systems

Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Prediction

2024-08-03 · Wenhao Li, Jie zhou, Chuan Luo, Chao Tang 외

In the realm of modern mobile E-commerce, providing users with nearby commercial service recommendations through location-based online services has become increasingly vital. While machine learning approaches have shown …

Click-Through Rate PredictionDiversity