paper-with-me

Papers

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

2024-09-25 · Yueqi Wang, Zhenrui Yue, Huimin Zeng, Dong Wang, Julian McAuley

Despite recent advancements in language and vision modeling, integrating rich multimodal knowledge into recommender systems continues to pose significant challenges. This is primarily due to the need for efficient recommendation, which requires adaptive and interactive responses. In this study, we focus on sequential recommendation and introduce a lightweight framework called full-scale Matryoshka representation learning for multimodal recommendation (fMRLRec). Our fMRLRec captures item features at different granularities, learning informative representations for efficient recommendation across multiple dimensions. To integrate item features from diverse modalities, fMRLRec employs a simple mapping to project multimodal item features into an aligned feature space. Additionally, we design an efficient linear transformation that embeds smaller features into larger ones, substantially reducing memory requirements for large-scale training on recommendation data. Combined with improved state space modeling techniques, fMRLRec scales to different dimensions and only requires one-time training to produce multiple models tailored to various granularities. We demonstrate the effectiveness and efficiency of fMRLRec on multiple benchmark datasets, which consistently achieves superior performance over state-of-the-art baseline methods. We make our code and data publicly available at https://github.com/yueqirex/fMRLRec.

📄 PDF Abstract BibTeX arXiv:2409.16627

Code (1)

yueqirex/fmrlrec 공식 구현 pytorch

Tasks

Multimodal RecommendationRecommendation SystemsRepresentation LearningSequential Recommendation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Matryoshka Concept Bottleneck Models

2026-05-20 · Ziye Chen, Hongbin Lin, Jie Li, Lijie Hu arxiv

Concept Bottleneck Models (CBMs) have emerged as a prominent paradigm for interpretable deep learning, learning by grounding predictions in human-understandable concepts. However, their practical deployment is hindered b…

Representation Learning

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding

2026-05-28 · Selim Kuzucu, Alessio Tonioni, Vasile Lup, Bernt Schiele 외 arxiv

Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by training a single model t…

Learning Multi-Level Features with Matryoshka Sparse Autoencoders

2025-03-21 · Bart Bussmann, Noa Nabeshima, Adam Karvonen, Neel Nanda

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting neural networks by extracting the concepts represented in their activations. However, choosing the size of the SAE dictionary (i.e. number of le…

SMEC: Rethinking Matryoshka Representation Learning for Retrieval Embedding Compression

2025-10-14 · Biao Zhang, Lixin Chen, Tong Liu, Bo Zheng arxiv

Large language models (LLMs) generate high-dimensional embeddings that capture rich semantic and syntactic information. However, high-dimensional embeddings exacerbate computational complexity and storage requirements, t…

Dimensionality ReductionRepresentation Learning

Cross-lingual Matryoshka Representation Learning across Speech and Text

2026-02-23 · Yaya Sy, Dioula Doucouré, Christophe Cerisara, Irina Illina arxiv

Speakers of under-represented languages face both a language barrier, as most online knowledge is in a few dominant languages, and a modality barrier, since information is largely text-based while many languages are prim…

Representation LearningIntent Detection