paper-with-me

홈 › Papers

M^2VAE: Multi-Modal Multi-View Variational Autoencoder for Cold-start Item Recommendation

2025-08-01 · Chuan He, Yongchao Liu, Qiang Li, Wenliang Zhong, Chuntao Hong, Xinwei Yao arxiv

Cold-start item recommendation is a significant challenge in recommendation systems, particularly when new items are introduced without any historical interaction data. While existing methods leverage multi-modal content to alleviate the cold-start issue, they often neglect the inherent multi-view structure of modalities, the distinction between shared and modality-specific features. In this paper, we propose Multi-Modal Multi-View Variational AutoEncoder (M^2VAE), a generative model that addresses the challenges of modeling common and unique views in attribute and multi-modal features, as well as user preferences over single-typed item features. Specifically, we generate type-specific latent variables for item IDs, categorical attributes, and image features, and use Product-of-Experts (PoE) to derive a common representation. A disentangled contrastive loss decouples the common view from unique views while preserving feature informativeness. To model user inclinations, we employ a preference-guided Mixture-of-Experts (MoE) to adaptively fuse representations. We further incorporate co-occurrence signals via contrastive learning, eliminating the need for pretraining. Extensive experiments on real-world datasets validate the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2508.00452

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsContrastive Learning

Similar Papers 제목 키워드 기반

M$^2$VAE - Derivation of a Multi-Modal Variational Autoencoder Objective from the Marginal Joint Log-Likelihood

2019-03-18 · Timo Korthals

This work gives an in-depth derivation of the trainable evidence lower bound obtained from the marginal joint log-Likelihood with the goal of training a Multi-Modal Variational Autoencoder (M$^2$VAE).

Multi-modal data generation with a deep metric variational autoencoder

2022-02-07 · Josefine Vilsbøll Sundgaard, Morten Rieger Hannemose, Søren Laugesen, Peter Bray 외

We present a deep metric variational autoencoder for multi-modal data generation. The variational autoencoder employs triplet loss in the latent space, which allows for conditional data generation by sampling in the late…

Data AugmentationTriplet

A Perceived Environment Design using a Multi-Modal Variational Autoencoder for learning Active-Sensing

2019-11-01 · Timo Korthals, Malte Schilling, Jürgen Leitner

This contribution comprises the interplay between a multi-modal variational autoencoder and an environment to a perceived environment, on which an agent can act. Furthermore, we conclude our work with a comparison to cur…

Multimodal Transformer for Parallel Concatenated Variational Autoencoders

2022-10-28 · Stephen D. Liang, Jerry M. Mendel

In this paper, we propose a multimodal transformer using parallel concatenated architecture. Instead of using patches, we use column stripes for images in R, G, B channels as the transformer input. The column stripes kee…

Decoder

Multimodal Variational Autoencoder: a Barycentric View

2024-12-29 · Peijie Qiu, Wenhui Zhu, Sayantan Kumar, Xiwen Chen 외

Multiple signal modalities, such as vision and sounds, are naturally present in real-world phenomena. Recently, there has been growing interest in learning generative models, in particular variational autoencoder (VAE), …

Mixture-of-ExpertsRepresentation Learning