Deep Retrieval: An End-to-End Structure Model for Large-Scale Recommendations
One of the core problems in large-scale recommendations is to retrieve top relevant candidates accurately and efficiently, preferably in sub-linear time. Previous approaches are mostly based on a two-step procedure: first learn an inner-product model and then use maximum inner product search (MIPS) algorithms to search top candidates, leading to potential loss of retrieval accuracy. In this paper, we present Deep Retrieval (DR), an end-to-end learnable structure model for large-scale recommendations. DR encodes all candidates into a discrete latent space. Those latent codes for the candidates are model parameters and to be learnt together with other neural network parameters to maximize the same objective function. With the model learnt, a beam search over the latent codes is performed to retrieve the top candidates. Empirically, we showed that DR, with sub-linear computational complexity, can achieve almost the same accuracy as the brute-force baseline.
Code (1)
Tasks
RetrievalSimilar Papers 제목 키워드 기반
Deep Retrieval: Learning A Retrievable Structure for Large-Scale Recommendations
One of the core problems in large-scale recommendations is to retrieve top relevant candidates accurately and efficiently, preferably in sub-linear time. Previous approaches are mostly based on a two-step procedure: firs…
Information RetrievalRecommendation SystemsRerankingRetrievalGPU-accelerated Multi-relational Parallel Graph Retrieval for Web-scale Recommendations
Web recommendations provide personalized items from massive catalogs for users, which rely heavily on retrieval stages to trade off the effectiveness and efficiency of selecting a small relevant set from billion-scale ca…
GPUMetric LearningRetrievalLiNR: Model Based Neural Retrieval on GPUs at LinkedIn
This paper introduces LiNR, LinkedIn's large-scale, GPU-based retrieval system. LiNR supports a billion-sized index on GPU models. We discuss our experiences and challenges in creating scalable, differentiable search ind…
AttributeGPUQuantizationRetrievalRAGEAR: Retrieval-Augmented Graph-Enhanced Academic Recommender
We present RAGEAR (Retrieval-Augmented Graph-Enhanced Academic Recommender), a neurosymbolic recommender system for academic course recommendation. RAGEAR combines dense retrieval over full lecture transcripts with a sym…
CRTS: A type system for representing clinical recommendations
Background: Clinical guidelines and recommendations are the driving wheels of the evidence-based medicine (EBM) paradigm, but these are available primarily as unstructured text and are generally highly heterogeneous in n…
ArticlesClinical KnowledgeRetrievalVocal Bursts Type Prediction