paper-with-me

홈 › Papers

MambaVideo for Discrete Video Tokenization with Channel-Split Quantization

2025-07-06 · Dawit Mureja Argaw, Xian Liu, Joon Son Chung, Ming-Yu Liu, Fitsum Reda arxiv

Discrete video tokenization is essential for efficient autoregressive generative modeling due to the high dimensionality of video data. This work introduces a state-of-the-art discrete video tokenizer with two key contributions. First, we propose a novel Mamba-based encoder-decoder architecture that overcomes the limitations of previous sequencebased tokenizers. Second, we introduce a new quantization scheme, channel-split quantization, which significantly enhances the representational power of quantized latents while preserving the token count. Our model sets a new state-of-the-art, outperforming both causal 3D convolutionbased and Transformer-based approaches across multiple datasets. Experimental results further demonstrate its robustness as a tokenizer for autoregressive video generation.

📄 PDF Abstract BibTeX arXiv:2507.04559

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

Resi-VidTok: An Efficient and Decomposed Progressive Tokenization Framework for Ultra-Low-Rate and Lightweight Video Transmission

2025-10-28 · Zhenyu Liu, Yi Ma, Rahim Tafazolli, Zhi Ding arxiv

Real-time transmission of video over wireless networks remains highly challenging, even with advanced deep models, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In this pap…

Video TokenCom: Textual Intent-Guided Multi-Rate Video Token Communications with UEP-Based Adaptive Source-Channel Coding

2026-03-02 · Jingxuan Men, Mahdi Boloursaz Mashhadi, Ning Wang, Yi Ma 외 arxiv

Token Communication (TokenCom) is a new paradigm, motivated by the recent success of Large AI Models (LAMs) and Multimodal Large Language Models (MLLMs), where tokens serve as unified units of communication and computati…

Semantic Communication

InfoTok: Adaptive Discrete Video Tokenizer via Information-Theoretic Compression

2025-12-18 · Haotian Ye, Qiyuan He, Jiaqi Han, Puheng Li 외 arxiv

Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present a significant bottleneck for current to…

LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior

2024-10-28 · Hanyu Wang, Saksham Suri, Yixuan Ren, Hao Chen 외

We present LARP, a novel video tokenizer designed to overcome limitations in current video tokenization methods for autoregressive (AR) generative models. Unlike traditional patchwise tokenizers that directly encode loca…

Video GenerationVideo Reconstruction

FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting

2021-09-07 · ICCV 2021 10 · Rui Liu, Hanming Deng, Yangyi Huang, Xiaoyu Shi 외

Transformer, as a strong and flexible architecture for modelling long-range relations, has been widely explored in vision tasks. However, when used in video inpainting that requires fine-grained representation, existed m…

Seeing Beyond the VisibleVideo Inpainting