paper-with-me

Papers

MRSE: An Efficient Multi-modality Retrieval System for Large Scale E-commerce

2024-08-27 · Hao Jiang, Haoxiang Zhang, Qingshan Hou, Chaofeng Chen, Weisi Lin, Jingchang Zhang, Annan Wang

Providing high-quality item recall for text queries is crucial in large-scale e-commerce search systems. Current Embedding-based Retrieval Systems (ERS) embed queries and items into a shared low-dimensional space, but uni-modality ERS rely too heavily on textual features, making them unreliable in complex contexts. While multi-modality ERS incorporate various data sources, they often overlook individual preferences for different modalities, leading to suboptimal results. To address these issues, we propose MRSE, a Multi-modality Retrieval System that integrates text, item images, and user preferences through lightweight mixture-of-expert (LMoE) modules to better align features across and within modalities. MRSE also builds user profiles at a multi-modality level and introduces a novel hybrid loss function that enhances consistency and robustness using hard negative sampling. Experiments on a large-scale dataset from Shopee and online A/B testing show that MRSE achieves an 18.9% improvement in offline relevance and a 3.7% gain in online core metrics compared to Shopee's state-of-the-art uni-modality system.

📄 PDF Abstract BibTeX arXiv:2408.14968

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

UniMRSeg: Unified Modality-Relax Segmentation via Hierarchical Self-Supervised Compensation

2025-09-19 · Xiaoqi Zhao, Youwei Pang, Chenyang Yu, Lihe Zhang 외 arxiv

Multi-modal image segmentation faces real-world deployment challenges from incomplete/corrupted modalities degrading performance. While existing methods address training-inference modality gaps via specialized per-combin…

Brain Tumor SegmentationSemantic SegmentationContrastive LearningObject Segmentation

MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT

2024-05-10 · Hartmut Häntze, Lina Xu, Christian J. Mertens, Felix J. Dorfner 외

Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans. Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-ho…

Model OptimizationOrgan SegmentationSegmentationTransfer Learning

Benchmarking Multi-Organ Segmentation Tools for Multi-Parametric T1-weighted Abdominal MRI

2025-04-10 · Nicole Tran, Anisa Prasad, Yan Zhuang, Tejas Sudharshan Mathai 외

The segmentation of multiple organs in multi-parametric MRI studies is critical for many applications in radiology, such as correlating imaging biomarkers with disease status (e.g., cirrhosis, diabetes). Recently, three …

BenchmarkingOrgan Segmentation

Pre-Processing MRSes

2013-03-01 · WS 2013 3 · Tore Bruland

Multimodal RAG for Unstructured Data:Leveraging Modality-Aware Knowledge Graphs with Hybrid Retrieval

2025-10-16 · Rashmi R, Vidyadhar Upadhya arxiv

Current Retrieval-Augmented Generation (RAG) systems primarily operate on unimodal textual data, limiting their effectiveness on unstructured multimodal documents. Such documents often combine text, images, tables, equat…

Question AnsweringKnowledge Graphs