paper-with-me

홈 › Papers

From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation

2026-08-21 · Tianlu Xie, Xin Ku, Mingjie Sun, Yunhao Sha, Lixiang Wang, Peng Wang, Yiyu Wang, Wenjin Wu, Zhaojie Liu, Peng Jiang, Wenwu Ou arxiv

Generative recommendation represents each item with a sequence of discrete Semantic IDs (SIDs) and predicts the sequence to retrieve the next item. Typical systems use multi-level residual quantization, which increases autoregressive decoding cost and creates a large hierarchical space that may be sparsely occupied. Static codebooks also become misaligned with current traffic as new items arrive and exposure distributions change. We propose a single-level large semantic codebook that replaces multiple residual semantic codes with one semantic token while retaining a separate collaborative disambiguation token to reduce item collisions. We further introduce an exposure-aware dynamic update mechanism based on temporal weight decay, exponential moving-average center updates, and an exposure-weighted penalty on SID changes. We also develop an offline evaluation framework covering representation quality, code utilization, cluster load, full-SID collision, and temporal stability. On two public datasets, the two-level SID improves mean Recall@10 by 5.0%-8.8% and mean NDCG@10 by 4.1%-5.1% for OneRec-V1, and by 7.1%-8.7% and 3.8%-8.5%, respectively, for OneRec-V2. Dynamic updating provides further gains on KuaiRec. Across three serving architectures, the shorter SID reduces estimated autoregressive-decoding FLOPs by 47.93%-48.70% and increases single-card QPS by 28.57%-47.0%. A five-day online A/B test serving 2.5% of production traffic improves the primary consumption metric by 0.792%.

📄 PDF Abstract BibTeX arXiv:2608.21012

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communication

2024-01-02 · Yingbin Zhou, Yaping Sun, GuanYing Chen, Xiaodong Xu 외

Vector quantization-based image semantic communication systems have successfully boosted transmission efficiency, but face challenges with conflicting requirements between codebook design and digital constellation modula…

2kQuantizationSemantic Communication

SemHiTok: A Unified Image Tokenizer via Semantic-Guided Hierarchical Codebook for Multimodal Understanding and Generation

2025-03-09 · Zisheng Chen, Chunwei Wang, Xiuwei Chen, Hang Xu 외

We present SemHiTok, a unified image Tokenizer via Semantic-Guided Hierarchical codebook that provides consistent discrete feature representations for multimodal understanding and generation tasks. Recently, unified mult…

UniCode$^2$: Cascaded Large-scale Codebooks for Unified Multimodal Understanding and Generation

2025-06-25 · Yanzhe Chen, Huasong Zhong, Yan Li, Zhenheng Yang

Unified multimodal large language models (MLLMs) have shown promise in jointly advancing multimodal understanding and generation, with visual codebooks discretizing images into tokens for autoregressive modeling. Existin…

16k

SGC-VQGAN: Towards Complex Scene Representation via Semantic Guided Clustering Codebook

2024-09-09 · Chenjing Ding, Chiyu Wang, Boshi Liu, Xi Guo 외

Vector quantization (VQ) is a method for deterministically learning features through discrete codebook representations. Recent works have utilized visual tokenizers to discretize visual regions for self-supervised repres…

ClusteringOnline ClusteringQuantizationRepresentation Learning

Towards Improved Text-Aligned Codebook Learning: Multi-Hierarchical Codebook-Text Alignment with Long Text

2025-03-03 · CVPR 2025 1 · Guotao Liang, Baoquan Zhang, Zhiyuan Wen, Junteng Zhao 외

Image quantization is a crucial technique in image generation, aimed at learning a codebook that encodes an image into a discrete token sequence. Recent advancements have seen researchers exploring learning multi-modal c…

Image GenerationQuantization