Learning deep structured semantic models for web search using clickthrough data
Latent semantic models, such as LSA, intend to map a query to its relevant documents at the semantic level where keyword-based matching often fails. In this study we strive to develop a series of new latent semantic models with a deep structure that project queries and documents into a common low-dimensional space where the relevance of a document given a query is readily computed as the distance between them. The proposed deep structured semantic models are discriminatively trained by maximizing the conditional likelihood of the clicked documents given a query using the clickthrough data. To make our models applicable to large-scale Web search applications, we also use a technique called word hashing, which is shown to effectively scale up our semantic models to handle large vocabularies which are common in such tasks. The new models are evaluated on a Web document ranking task using a real-world data set. Results show that our best model significantly outperforms other latent semantic models, which were considered state-of-the-art in the performance prior to the work presented in this paper.
Code (6)
Tasks
Document RankingSimilar Papers 제목 키워드 기반
Multitask Text-to-Visual Embedding with Titles and Clickthrough Data
Text-visual (or called semantic-visual) embedding is a central problem in vision-language research. It typically involves mapping of an image and a text description to a common feature space through a CNN image encoder a…
Image RetrievalRetrievalTripletLearning High-level Image Representation for Image Retrieval via Multi-Task DNN using Clickthrough Data
Image retrieval refers to finding relevant images from an image database for a query, which is considered difficult for the gap between low-level representation of images and high-level representation of queries. Recentl…
Image RetrievalRetrievalContext Enhanced Short Text Matching using Clickthrough Data
The short text matching task employs a model to determine whether two short texts have the same semantic meaning or intent. Existing short text matching models usually rely on the content of short texts which are lack in…
Text MatchingLearning Colour Representations of Search Queries
Image search engines rely on appropriately designed ranking features that capture various aspects of the content semantics as well as the historic popularity. In this work, we consider the role of colour in this relevanc…
Image RetrievalDimensionality reduction for click-through rate prediction: Dense versus sparse representation
In online advertising, display ads are increasingly being placed based on real-time auctions where the advertiser who wins gets to serve the ad. This is called real-time bidding (RTB). In RTB, auctions have very tight ti…
Click-Through Rate PredictionDimensionality Reduction