paper-with-me

홈 › Papers

SPM: Structured Pretraining and Matching Architectures for Relevance Modeling in Meituan Search

2023-08-15 · Wen Zan, Yaopeng Han, Xiaotian Jiang, Yao Xiao, Yang Yang, Dayao Chen, Sheng Chen

In e-commerce search, relevance between query and documents is an essential requirement for satisfying user experience. Different from traditional e-commerce platforms that offer products, users search on life service platforms such as Meituan mainly for product providers, which usually have abundant structured information, e.g. name, address, category, thousands of products. Modeling search relevance with these rich structured contents is challenging due to the following issues: (1) there is language distribution discrepancy among different fields of structured document, making it difficult to directly adopt off-the-shelf pretrained language model based methods like BERT. (2) different fields usually have different importance and their length vary greatly, making it difficult to extract document information helpful for relevance matching. To tackle these issues, in this paper we propose a novel two-stage pretraining and matching architecture for relevance matching with rich structured documents. At pretraining stage, we propose an effective pretraining method that employs both query and multiple fields of document as inputs, including an effective information compression method for lengthy fields. At relevance matching stage, a novel matching method is proposed by leveraging domain knowledge in search query to generate more effective document representations for relevance scoring. Extensive offline experiments and online A/B tests on millions of users verify that the proposed architectures effectively improve the performance of relevance modeling. The model has already been deployed online, serving the search traffic of Meituan for over a year.

📄 PDF Abstract BibTeX arXiv:2308.07711

Code (0)

등록된 구현이 없습니다.

Tasks

Language Modelling

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling

2019-11-01 · IJCNLP 2019 11 · Jinfeng Rao, Linqing Liu, Yi Tay, Wei Yang 외

A core problem of information retrieval (IR) is relevance matching, which is to rank documents by relevance to a user{'}s query. On the other hand, many NLP problems, such as question answering and paraphrase identificat…

Information RetrievalParaphrase IdentificationQuestion AnsweringRetrieval+1

Robust Interaction-Based Relevance Modeling for Online e-Commerce Search

2024-06-04 · Ben Chen, Huangyu Dai, Xiang Ma, Wen Jiang 외

Semantic relevance calculation is crucial for e-commerce search engines, as it ensures that the items selected closely align with customer intent. Inadequate attention to this aspect can detrimentally affect user experie…

RetrievalSentenceText Matching

Improving Topic Relevance Model by Mix-structured Summarization and LLM-based Data Augmentation

2024-04-03 · Yizhu Liu, Ran Tao, Shengyu Guo, Yifan Yang

Topic relevance between query and document is a very important part of social search, which can evaluate the degree of matching between document and user's requirement. In most social search scenarios such as Dianping, m…

Data AugmentationLanguage ModelingLanguage ModellingLarge Language Model

Structured Alignment Networks for Matching Sentences

2018-10-01 · EMNLP 2018 10 · Yang Liu, Matt Gardner, Mirella Lapata

Many tasks in natural language processing involve comparing two sentences to compute some notion of relevance, entailment, or similarity. Typically this comparison is done either at the word level or at the sentence leve…

Natural Language InferenceQuestion AnsweringSentence

Modeling Diverse Relevance Patterns in Ad-hoc Retrieval

2018-05-15 · SIGIR '18 2018 5 · Yixing Fan, Jiafeng Guo, Yanyan Lan, Jun Xu 외

Assessing relevance between a query and a document is challenging in ad-hoc retrieval due to its diverse patterns, i.e., a document could be relevant to a query as a whole or partially as long as it provides sufficient i…

Retrieval