paper-with-me

홈 › Papers

Coarse-to-Fine Lightweight Meta-Embedding for ID-Based Recommendation

2025-01-21 · Yang Wang, Haipeng Liu, Zeqian Yi, Biao Qian, Meng Wang

The state-of-the-art recommendation systems have shifted the attention to efficient recommendation, e.g., on-device recommendation, under memory constraints. To this end, the existing methods either focused on the lightweight embeddings for both users and items, or involved on-device systems enjoying the compact embeddings to enhance reusability and reduces space complexity. However, they focus solely on the coarse granularity of embedding, while overlook the fine-grained semantic nuances, to adversarially downgrade the efficacy of meta-embeddings in capturing the intricate relationship over both user and item, consequently resulting into the suboptimal recommendations. In this paper, we aim to study how the meta-embedding can efficiently learn varied grained semantics, together with how the fine-grained meta-embedding can strengthen the representation of coarse-grained meta-embedding. To answer these questions, we develop a novel graph neural networks (GNNs) based recommender where each user and item serves as the node, linked directly to coarse-grained virtual nodes and indirectly to fine-grained virtual nodes, ensuring different grained semantic learning, while disclosing: 1) In contrast to coarse-grained semantics, fine-grained semantics are well captured through sparse meta-embeddings, which adaptively 2) balance the embedding uniqueness and memory constraint. Additionally, the initialization method come up upon SparsePCA, along with a soft thresholding activation function to render the sparseness of the meta-embeddings. We propose a weight bridging update strategy that focuses on matching each coarse-grained meta-embedding with several fine-grained meta-embeddings based on the users/items' semantics. Extensive experiments substantiate our method's superiority over existing baselines. Our code is available at https://github.com/htyjers/C2F-MetaEmbed.

📄 PDF Abstract BibTeX arXiv:2501.11870

Code (1)

htyjers/c2f-metaembed 공식 구현 pytorch

Tasks

Recommendation Systems

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Lightweight Embeddings for Graph Collaborative Filtering

2024-03-27 · Xurong Liang, Tong Chen, Lizhen Cui, Yang Wang 외

Graph neural networks (GNNs) are currently one of the most performant collaborative filtering methods. Meanwhile, owing to the use of an embedding table to represent each user/item as a distinct vector, GNN-based recomme…

Collaborative FilteringSemantic SimilaritySemantic Textual Similarity

Efficient Cold-Start Recommendation via BPE Token-Level Embedding Initialization with LLM

2025-09-16 · Yushang Zhao, Xinyue Han, Qian Leng, Qianyi Sun 외 arxiv

The cold-start issue is the challenge when we talk about recommender systems, especially in the case when we do not have the past interaction data of new users or new items. Content-based features or hybrid solutions are…

Collaborative Filtering

Compressed Video Aggregator: Content-driven Module for Efficient Micro-Video Recommendation

2026-05-09 · Yang Xiao, Huiyuan Chen, Kaiyuan Deng, Chao Jiang 외 arxiv

We propose \textbf{Compressed Video Aggregator} (CVA), a lightweight micro-video recommendation module that decouples video information from preference learning. CVA first summarizes frozen VFM frame embeddings into a se…

Lightweight Embeddings with Graph Rewiring for Collaborative Filtering

2025-05-25 · Xurong Liang, Tong Chen, Wei Yuan, Hongzhi Yin

As recommendation services scale rapidly and their deployment now commonly involves resource-constrained edge devices, GNN-based recommender systems face significant challenges, including high embedding storage costs and…

Collaborative FilteringRecommendation Systems

Towards Cross-Granularity Few-Shot Learning: Coarse-to-Fine Pseudo-Labeling with Visual-Semantic Meta-Embedding

2020-07-11 · Jinhai Yang, Hua Yang, Lin Chen

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essential…

ClassificationFew-Shot LearningGeneral ClassificationMeta-Learning