Deep Natural Language Processing for LinkedIn Search Systems
Many search systems work with large amounts of natural language data, e.g., search queries, user profiles and documents, where deep learning based natural language processing techniques (deep NLP) can be of great help. In this paper, we introduce a comprehensive study of applying deep NLP techniques to five representative tasks in search engines. Through the model design and experiments of the five tasks, readers can find answers to three important questions: (1) When is deep NLP helpful/not helpful in search systems? (2) How to address latency challenges? (3) How to ensure model robustness? This work builds on existing efforts of LinkedIn search, and is tested at scale on a commercial search engine. We believe our experiences can provide useful insights for the industry and research communities.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Natural Language Processing for LinkedIn Search
Many search systems work with large amounts of natural language data, e.g., search queries, user profiles, and documents. Building a successful search system requires a thorough understanding of textual data semantics, w…
Document RankingLanguage ModelingLanguage ModellingIntroducing Semantic Capability in LinkedIn's Content Search Engine
In the past, most search queries issued to a search engine were short and simple. A keyword based search engine was able to answer such queries quite well. However, members are now developing the habit of issuing long an…
Natural Language QueriesTalent Search and Recommendation Systems at LinkedIn: Practical Challenges and Lessons Learned
LinkedIn Talent Solutions business contributes to around 65% of LinkedIn's annual revenue, and provides tools for job providers to reach out to potential candidates and for job seekers to find suitable career opportuniti…
Information RetrievalRecommendation SystemsRetrievalTowards Deep and Representation Learning for Talent Search at LinkedIn
Talent search and recommendation systems at LinkedIn strive to match the potential candidates to the hiring needs of a recruiter or a hiring manager expressed in terms of a search query or a job posting. Recent work in t…
Learning Semantic RepresentationsLearning-To-RankRecommendation SystemsRepresentation LearningSemantic Search At LinkedIn
Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present LinkedIn's LLM-based semantic search fra…