paper-with-me

Papers

MONET: Modality-Embracing Graph Convolutional Network and Target-Aware Attention for Multimedia Recommendation

2023-12-15 · Yungi Kim, Taeri Kim, Won-Yong Shin, Sang-Wook Kim

In this paper, we focus on multimedia recommender systems using graph convolutional networks (GCNs) where the multimodal features as well as user-item interactions are employed together. Our study aims to exploit multimodal features more effectively in order to accurately capture users' preferences for items. To this end, we point out following two limitations of existing GCN-based multimedia recommender systems: (L1) although multimodal features of interacted items by a user can reveal her preferences on items, existing methods utilize GCN designed to focus only on capturing collaborative signals, resulting in insufficient reflection of the multimodal features in the final user/item embeddings; (L2) although a user decides whether to prefer the target item by considering its multimodal features, existing methods represent her as only a single embedding regardless of the target item's multimodal features and then utilize her embedding to predict her preference for the target item. To address the above issues, we propose a novel multimedia recommender system, named MONET, composed of following two core ideas: modality-embracing GCN (MeGCN) and target-aware attention. Through extensive experiments using four real-world datasets, we demonstrate i) the significant superiority of MONET over seven state-of-the-art competitors (up to 30.32% higher accuracy in terms of recall@20, compared to the best competitor) and ii) the effectiveness of the two core ideas in MONET. All MONET codes are available at https://github.com/Kimyungi/MONET.

📄 PDF Abstract BibTeX arXiv:2312.09511

Code (1)

kimyungi/monet 공식 구현 pytorch

Tasks

Multimedia recommendationRecommendation Systems

Methods 이 논문이 사용한 방법론

Focus 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
MoNet Mixture model network (MoNet) is a general framework allowing to design convolutional deep architectures on non-Euclidean domains such as graphs and manifolds. Image and…

Similar Papers 제목 키워드 기반

Embracing Aleatoric Uncertainty in Medical Multimodal Learning with Missing Modalities

2026-01-29 · Linxiao Gong, Yang Liu, Lianlong Sun, Yulai Bi 외 arxiv

Medical multimodal learning faces significant challenges with missing modalities prevalent in clinical practice. Existing approaches assume equal contribution of modality and random missing patterns, neglecting inherent …

Mortality Prediction

Monetary-fiscal interactions under price level targeting

2020-10-28

The adoption of a "makeup" strategy is one of the proposals in the ongoing review of the Fed's monetary policy framework. Another suggestion, to avoid the zero lower bound, is a more active role for fiscal policy. We put…

The MONET dataset: Multimodal drone thermal dataset recorded in rural scenarios

2023-04-11 · Luigi Riz, Andrea Caraffa, Matteo Bortolon, Mohamed Lamine Mekhalfi 외

We present MONET, a new multimodal dataset captured using a thermal camera mounted on a drone that flew over rural areas, and recorded human and vehicle activities. We captured MONET to study the problem of object locali…

object-detectionObject DetectionTransfer Learning

Vision-Grounded Machine Interpreting: Improving the Translation Process through Visual Cues

2025-09-28 · Claudio Fantinuoli arxiv

Machine Interpreting systems are currently implemented as unimodal, real-time speech-to-speech architectures, processing translation exclusively on the basis of the linguistic signal. Such reliance on a single modality, …

Visual Grounding

Translate-Train Embracing Translationese Artifacts

2022-05-01 · ACL 2022 5 · Sicheng Yu, Qianru Sun, Hao Zhang, Jing Jiang

Translate-train is a general training approach to multilingual tasks. The key idea is to use the translator of the target language to generate training data to mitigate the gap between the source and target languages. Ho…