paper-with-me

홈 › Papers

Learning Binarized Graph Representations with Multi-faceted Quantization Reinforcement for Top-K Recommendation

2022-06-05 · Yankai Chen, Huifeng Guo, Yingxue Zhang, Chen Ma, Ruiming Tang, Jingjie Li, Irwin King

Learning vectorized embeddings is at the core of various recommender systems for user-item matching. To perform efficient online inference, representation quantization, aiming to embed the latent features by a compact sequence of discrete numbers, recently shows the promising potentiality in optimizing both memory and computation overheads. However, existing work merely focuses on numerical quantization whilst ignoring the concomitant information loss issue, which, consequently, leads to conspicuous performance degradation. In this paper, we propose a novel quantization framework to learn Binarized Graph Representations for Top-K Recommendation (BiGeaR). BiGeaR introduces multi-faceted quantization reinforcement at the pre-, mid-, and post-stage of binarized representation learning, which substantially retains the representation informativeness against embedding binarization. In addition to saving the memory footprint, BiGeaR further develops solid online inference acceleration with bitwise operations, providing alternative flexibility for the realistic deployment. The empirical results over five large real-world benchmarks show that BiGeaR achieves about 22%~40% performance improvement over the state-of-the-art quantization-based recommender system, and recovers about 95%~102% of the performance capability of the best full-precision counterpart with over 8x time and space reduction.

📄 PDF Abstract BibTeX arXiv:2206.02115

Code (0)

등록된 구현이 없습니다.

Tasks

BinarizationInformativenessQuantizationRecommendation SystemsRepresentation Learning

Similar Papers 제목 키워드 기반

Variation-aware Binarized Memristive Networks

2019-10-14 · Corey Lammie, Olga Krestinskaya, Alex James, Mostafa Rahimi Azghadi

The quantization of weights to binary states in Deep Neural Networks (DNNs) can replace resource-hungry multiply accumulate operations with simple accumulations. Such Binarized Neural Networks (BNNs) exhibit greatly redu…

Quantization

A Greedy Bit-flip Training Algorithm for Binarized Knowledge Graph Embeddings

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Katsuhiko Hayashi, Koki Kishimoto, Masashi Shimbo

This paper presents a simple and effective discrete optimization method for training binarized knowledge graph embedding model B-CP. Unlike the prior work using a SGD-based method and quantization of real-valued vectors,…

Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingKnowledge Graph Embeddings+1

Asymmetric Generative Recommendation via Multi-Expert Projection and Multi-Faceted Hierarchical Quantization

2026-05-14 · Bin Huang, Xin Wang, Junwei Pan, Yongqi Zhou 외 arxiv

Generative Recommendation (GenRec) models reformulate recommendation as a sequence generation task, representing items as discrete Semantic IDs used symmetrically as both inputs and prediction targets. We identify a crit…

Toward Extremely Low Bit and Lossless Accuracy in DNNs with Progressive ADMM

2019-05-02 · Sheng Lin, Xiaolong Ma, Shaokai Ye, Geng Yuan 외

Weight quantization is one of the most important techniques of Deep Neural Networks (DNNs) model compression method. A recent work using systematic framework of DNN weight quantization with the advanced optimization algo…

Model CompressionQuantization

PB-LLM: Partially Binarized Large Language Models

2023-09-29 · Yuzhang Shang, Zhihang Yuan, Qiang Wu, Zhen Dong

This paper explores network binarization, a radical form of quantization, compressing model weights to a single bit, specifically for Large Language Models (LLMs) compression. Due to previous binarization methods collaps…

BinarizationQuantization