A Semantic Alignment System for Multilingual Query-Product Retrieval

2022-08-05 · Qi Zhang, Zijian Yang, Yilun Huang, Ze Chen, Zijian Cai, Kangxu Wang, Jiewen Zheng, Jiarong He, Jin Gao

This paper mainly describes our winning solution (team name: www) to Amazon ESCI Challenge of KDD CUP 2022, which achieves a NDCG score of 0.9043 and wins the first place on task 1: the query-product ranking track. In this competition, participants are provided with a real-world large-scale multilingual shopping queries data set and it contains query-product pairs in English, Japanese and Spanish. Three different tasks are proposed in this competition, including ranking the results list as task 1, classifying the query/product pairs into Exact, Substitute, Complement, or Irrelevant (ESCI) categories as task 2 and identifying substitute products for a given query as task 3. We mainly focus on task 1 and propose a semantic alignment system for multilingual query-product retrieval. Pre-trained multilingual language models (LM) are adopted to get the semantic representation of queries and products. Our models are all trained with cross-entropy loss to classify the query-product pairs into ESCI 4 categories at first, and then we use weighted sum with the 4-class probabilities to get the score for ranking. To further boost the model, we also do elaborative data preprocessing, data augmentation by translation, specially handling English texts with English LMs, adversarial training with AWP and FGM, self distillation, pseudo labeling, label smoothing and ensemble. Finally, Our solution outperforms others both on public and private leaderboard.

📄 PDF Abstract BibTeX arXiv:2208.02958

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation RetrievalTask 2

Methods 이 논문이 사용한 방법론

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

LAMAR: An Open Language-Aware Multilingual Alignment Reranker

2026-07-24 · Seongtae Hong, Youngjoon Jang, Jungseob Lee, Seungyoon Lee 외 hf

In multilingual retrieval augmented generation, a retriever can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether exi…

Answer Generation

Analyticup E-commerce Product Search Competition Technical Report from Team Tredence_AICOE

2025-10-23 · Rakshith R, Shubham Sharma, Mohammed Sameer Khan, Ankush Chopra arxiv

This study presents the multilingual e-commerce search system developed by the Tredence_AICOE team. The competition features two multilingual relevance tasks: Query-Category (QC) Relevance, which evaluates how well a use…

Data Augmentation

What Drives Cross-lingual Ranking? Retrieval Approaches with Multilingual Language Models

2025-11-24 · Roksana Goworek, Olivia Macmillan-Scott, Eda B. Özyiğit arxiv

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existin…

Information Retrieval Contrastive Learning

Semantic Retrieval for Product Search in E-Commerce

2026-05-31 · Nikhil Kothari, Saksham Samdani, Ritam Mallick, Praveen Gupta 외 arxiv

Semantic retrieval in e-commerce must handle short, noisy, and colloquial queries over large product catalogs with fine-grained attribute distinctions. We present a Siamese LLM dual-encoder trained through a two-stage pi…

Contrastive Learning Semantic Retrieval

Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning

2023-09-15 · Meryem M'hamdi, Jonathan May, Franck Dernoncourt, Trung Bui 외

Multilingual semantic search is the task of retrieving relevant contents to a query expressed in different language combinations. This requires a better semantic understanding of the user's intent and its contextual mean…

Sentence