Semantic Search At LinkedIn
Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present LinkedIn's LLM-based semantic search framework for AI Job Search and AI People Search, combining an LLM relevance judge, embedding-based retrieval, and a compact Small Language Model trained via multi-teacher distillation to jointly optimize relevance and engagement. A prefill-oriented inference architecture co-designed with model pruning, context compression, and text-embedding hybrid interactions boosts ranking throughput by over 75x under a fixed latency constraint while preserving near-teacher-level NDCG, enabling one of the first production LLM-based ranking systems with efficiency comparable to traditional approaches and delivering significant gains in quality and user engagement.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Introducing Semantic Capability in LinkedIn's Content Search Engine
In the past, most search queries issued to a search engine were short and simple. A keyword based search engine was able to answer such queries quite well. However, members are now developing the habit of issuing long an…
Natural Language QueriesTowards Deep and Representation Learning for Talent Search at LinkedIn
Talent search and recommendation systems at LinkedIn strive to match the potential candidates to the hiring needs of a recruiter or a hiring manager expressed in terms of a search query or a job posting. Recent work in t…
Learning Semantic RepresentationsLearning-To-RankRecommendation SystemsRepresentation LearningPersonalized Expertise Search at LinkedIn
LinkedIn is the largest professional network with more than 350 million members. As the member base increases, searching for experts becomes more and more challenging. In this paper, we propose an approach to address the…
Collaborative FilteringDeep Natural Language Processing for LinkedIn Search
Many search systems work with large amounts of natural language data, e.g., search queries, user profiles, and documents. Building a successful search system requires a thorough understanding of textual data semantics, w…
Document RankingLanguage ModelingLanguage ModellingTalent Search and Recommendation Systems at LinkedIn: Practical Challenges and Lessons Learned
LinkedIn Talent Solutions business contributes to around 65% of LinkedIn's annual revenue, and provides tools for job providers to reach out to potential candidates and for job seekers to find suitable career opportuniti…
Information RetrievalRecommendation SystemsRetrieval