paper-with-me

홈 › Papers

Reward-Forcing: Autoregressive Video Generation with Reward Feedback

2026-01-23 · Jingran Zhang, Ning Li, Yuanhao Ban, Andrew Bai, Justin Cui arxiv

While most prior work in video generation relies on bidirectional architectures, recent efforts have sought to adapt these models into autoregressive variants to support near real-time generation. However, such adaptations often depend heavily on teacher models, which can limit performance, particularly in the absence of a strong autoregressive teacher, resulting in output quality that typically lags behind their bidirectional counterparts. In this paper, we explore an alternative approach that uses reward signals to guide the generation process, enabling more efficient and scalable autoregressive generation. By using reward signals to guide the model, our method simplifies training while preserving high visual fidelity and temporal consistency. Through extensive experiments on standard benchmarks, we find that our approach performs comparably to existing autoregressive models and, in some cases, surpasses similarly sized bidirectional models by avoiding constraints imposed by teacher architectures. For example, on VBench, our method achieves a total score of 84.92, closely matching state-of-the-art autoregressive methods that score 84.31 but require significant heterogeneous distillation.

📄 PDF Abstract BibTeX arXiv:2601.16933

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation

2026-02-02 · Hongzhou Zhu, Min Zhao, Guande He, Hang Su 외 arxiv

To achieve real-time interactive video generation, current methods distill pretrained bidirectional video diffusion models into few-step autoregressive (AR) models, facing an architectural gap when full attention is repl…

Instruction FollowingVideo Generation

Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion

2026-06-02 · Matiur Rahman Minar, Seunghun Oh, GangHyeon Jeong, Unsang Park arxiv

Autoregressive video diffusion models enable streaming generation but often degrade over long rollouts: static scene layouts drift, while mechanisms that improve spatial stability tend to suppress motion, causing natural…

Video Generation

AR-CoPO: Align Autoregressive Video Generation with Contrastive Policy Optimization

2026-03-18 · Dailan He, Guanlin Feng, Xingtong Ge, Yi Zhang 외 arxiv

Streaming autoregressive (AR) video generators combined with few-step distillation achieve low-latency, high-quality synthesis, yet remain difficult to align via reinforcement learning from human feedback (RLHF). Existin…

Reinforcement LearningDomain GeneralizationVideo Generation

TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL

2026-06-26 · Jing Wang, Xiangxin Zhou, Jiajun Liang, Kaiqi Liu 외 arxiv

Autoregressive (AR) video diffusion models enable low-latency streaming generation by synthesizing videos chunk by chunk with cached visual context, but this chunk-wise formulation makes temporal instruction following am…

Reinforcement LearningInstruction FollowingVideo Generation

Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillation

2025-12-04 · Yunhong Lu, Yanhong Zeng, Haobo Li, Hao Ouyang 외 arxiv

Efficient streaming video generation is critical for simulating interactive and dynamic worlds. Existing methods distill few-step video diffusion models with sliding window attention, using initial frames as sink tokens …

Video Generation