paper-with-me

Papers

Less is More: Information Bottleneck Denoised Multimedia Recommendation

2025-01-21 · Yonghui Yang, Le Wu, Zhuangzhuang He, Zhengwei Wu, Richang Hong, Meng Wang

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or uncovering latent item-item structures based on modality similarity. Despite the effectiveness, we posit that these methods are usually suboptimal due to the introduction of irrelevant multimedia features into recommendation tasks. This stems from the fact that generic multimedia feature extractors, while well-designed for domain-specific tasks, can inadvertently introduce task-irrelevant features, leading to potential misguidance of recommenders. In this work, we propose a denoised multimedia recommendation paradigm via the Information Bottleneck principle (IB). Specifically, we propose a novel Information Bottleneck denoised Multimedia Recommendation (IBMRec) model to tackle the irrelevant feature issue. IBMRec removes task-irrelevant features from both feature and item-item structure perspectives, which are implemented by two-level IB learning modules: feature-level (FIB) and graph-level (GIB). In particular, FIB focuses on learning the minimal yet sufficient multimedia features. This is achieved by maximizing the mutual information between multimedia representation and recommendation tasks, while concurrently minimizing it between multimedia representation and pre-trained multimedia features. Furthermore, GIB is designed to learn the robust item-item graph structure, it refines the item-item graph based on preference affinity, then minimizes the mutual information between the original graph and the refined one. Extensive experiments across three benchmarks validate the effectiveness of our proposed model, showcasing high performance, and applicability to various multimedia recommenders.

📄 PDF Abstract BibTeX arXiv:2501.12175

Code (0)

등록된 구현이 없습니다.

Tasks

Multimedia recommendation

Similar Papers 제목 키워드 기반

Graph Bottlenecked Social Recommendation

2024-06-12 · Yonghui Yang, Le Wu, Zihan Wang, Zhuangzhuang He 외

With the emergence of social networks, social recommendation has become an essential technique for personalized services. Recently, graph-based social recommendations have shown promising results by capturing the high-or…

Denoising

VA-FastNavi-MARL: Real-Time Robot Control with Multimedia-Driven Meta-Reinforcement Learning

2026-04-05 · Yang Zhang, Shengxi Jing, Fengxiang Wang, Yuan Feng 외 arxiv

Interpreting dynamic, heterogeneous multimedia commands with real-time responsiveness is critical for Human-Robot Interaction. We present VA-FastNavi-MARL, a framework that aligns asynchronous audio-visual inputs into a …

Reinforcement Learning

Cross-lingual Prosody Transfer for Expressive Machine Dubbing

2023-06-20 · Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Patrick Lumban Tobing 외

Prosody transfer is well-studied in the context of expressive speech synthesis. Cross-lingual prosody transfer, however, is challenging and has been under-explored to date. In this paper, we present a novel solution to l…

Expressive Speech SynthesisSpeech Synthesis

Compensatory Mechanisms in Non-principal Multimedia Learning: The Interplay of Local and Global Information Processing

2024-09-19 · Mohammadhosein Ostadi Varnosfaderani, Masoumeh Golmohamadian, Alireza Bosaghzadeh, S. Hamid Amiri 외

Educational multimedia has become increasingly important in modern learning environments because of its cost-effectiveness and ability to overcome the temporal and spatial limitations of traditional methods. However, the…

EEG

Towards an All-Purpose Content-Based Multimedia Information Retrieval System

2019-02-11 · Ralph Gasser, Luca Rossetto, Heiko Schuldt

The growth of multimedia collections - in terms of size, heterogeneity, and variety of media types - necessitates systems that are able to conjointly deal with several forms of media, especially when it comes to searchin…

AllInformation RetrievalManagementRetrieval