Applied Federated Learning: Improving Google Keyboard Query Suggestions
Federated learning is a distributed form of machine learning where both the training data and model training are decentralized. In this paper, we use federated learning in a commercial, global-scale setting to train, evaluate and deploy a model to improve virtual keyboard search suggestion quality without direct access to the underlying user data. We describe our observations in federated training, compare metrics to live deployments, and present resulting quality increases. In whole, we demonstrate how federated learning can be applied end-to-end to both improve user experiences and enhance user privacy.
Code (1)
Tasks
BIG-bench Machine LearningFederated LearningSimilar Papers 제목 키워드 기반
Federated Learning of Gboard Language Models with Differential Privacy
We train language models (LMs) with federated learning (FL) and differential privacy (DP) in the Google Keyboard (Gboard). We apply the DP-Follow-the-Regularized-Leader (DP-FTRL)~\citep{kairouz21b} algorithm to achieve m…
Federated LearningTwo Models are Better than One: Federated Learning Is Not Private For Google GBoard Next Word Prediction
In this paper we present new attacks against federated learning when used to train natural language text models. We illustrate the effectiveness of the attacks against the next word prediction model used in Google's GBoa…
Federated LearningInvestigating Bias in Political Search Query Suggestions by Relative Comparison with LLMs
Search query suggestions affect users' interactions with search engines, which then influences the information they encounter. Thus, bias in search query suggestions can lead to exposure to biased search results and can …
Application of federated learning in manufacturing
A vast amount of data is created every minute, both in the private sector and industry. Whereas it is often easy to get hold of data in the private entertainment sector, in the industrial production environment it is muc…
Federated LearningDeveloping a Meta-suggestion Engine for Search Queries
Typically, search engines provide query suggestions to assist users in the search process. Query suggestions are very important for improving users search experience. However, most query suggestions are based on the user…
RerankingRe-Ranking