paper-with-me

Papers

BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation

2025-04-09 · Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai

Multi-modal sequential recommendation systems leverage auxiliary signals (e.g., text, images) to alleviate data sparsity in user-item interactions. While recent methods exploit large language models to encode modalities into discrete semantic IDs for autoregressive prediction, we identify two critical limitations: (1) Existing approaches adopt fragmented quantization, where modalities are independently mapped to semantic spaces misaligned with behavioral objectives, and (2) Over-reliance on semantic IDs disrupts inter-modal semantic coherence, thereby weakening the expressive power of multi-modal representations for modeling diverse user preferences. To address these challenges, we propose a Behavior-Bind multi-modal Quantization for Sequential Recommendation (BBQRec for short) featuring dual-aligned quantization and semantics-aware sequence modeling. First, our behavior-semantic alignment module disentangles modality-agnostic behavioral patterns from noisy modality-specific features through contrastive codebook learning, ensuring semantic IDs are inherently tied to recommendation tasks. Second, we design a discretized similarity reweighting mechanism that dynamically adjusts self-attention scores using quantized semantic relationships, preserving multi-modal synergies while avoiding invasive modifications to the sequence modeling architecture. Extensive evaluations across four real-world benchmarks demonstrate BBQRec's superiority over the state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2504.06636

Code (0)

등록된 구현이 없습니다.

Tasks

QuantizationRecommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here

Similar Papers 제목 키워드 기반

CodeBind: Decoupled Representation Learning for Multimodal Alignment with Unified Compositional Codebook

2026-05-18 · Zeyu Chen, Jie Li, Kai Han arxiv

Multimodal representation alignment is pivotal for large language models and robotics. Traditional methods are often hindered by cross-modal information discrepancies and data scarcity, leading to suboptimal alignment sp…

Representation Learning

Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Data

2025-09-23 · Mohammad Hosseini, Maryam M. Shanechi arxiv

High-dimensional imaging of neural activity, such as widefield calcium and functional ultrasound imaging, provide a rich source of information for understanding the relationship between brain activity and behavior. Accur…

Exact Probability Landscapes of Stochastic Phenotype Switching in Feed-Forward Loops: Phase Diagrams of Multimodality

2021-04-06 · Anna Terebus, Farid Manuchehrfar, Youfang Cao, Jie Liang

Feed-forward loops (FFLs) are among the most ubiquitously found motifs of reaction networks in nature. However, little is known about their stochastic behavior and the variety of network phenotypes they can exhibit. In t…

CLIP Behaves like a Bag-of-Words Model Cross-modally but not Uni-modally

2025-02-05 · Darina Koishigarina, Arnas Uselis, Seong Joon Oh

CLIP (Contrastive Language-Image Pretraining) has become a popular choice for various downstream tasks. However, recent studies have questioned its ability to represent compositional concepts effectively. These works sug…

Attributecross-modal alignment

ImageBind-LLM: Multi-modality Instruction Tuning

2023-09-07 · Jiaming Han, Renrui Zhang, Wenqi Shao, Peng Gao 외

We present ImageBind-LLM, a multi-modality instruction tuning method of large language models (LLMs) via ImageBind. Existing works mainly focus on language and image instruction tuning, different from which, our ImageBin…

Instruction FollowingText Generation