paper-with-me

Papers

VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment

2026-03-17 · Tengjiao Yin, Jinglei Shi, Heng Guo, Xi Wang arxiv

Video diffusion models lack explicit geometric supervision during training, leading to inconsistency artifacts such as object deformation, spatial drift, and depth violations in generated videos. To address this limitation, we propose a geometry-based reward model that leverages pretrained geometric foundation models to evaluate multi-view consistency through cross-frame reprojection error. Unlike previous geometric metrics that measure inconsistency in pixel space, where pixel intensity may introduce additional noise, our approach conducts error computation in a pointwise fashion, yielding a more physically grounded and robust error metric. Furthermore, we introduce a geometry-aware sampling strategy that filters out low-texture and non-semantic regions, focusing evaluation on geometrically meaningful areas with reliable correspondences to improve robustness. We apply this reward model to align video diffusion models through two complementary pathways: post-training of a bidirectional model via SFT or Reinforcement Learning and inference-time optimization of a Causal Video Model (e.g., Streaming video generator) via test-time scaling with our reward as a path verifier. Experimental results validate the effectiveness of our design, demonstrating that our geometry-based reward provides superior robustness compared to other variants. By enabling efficient inference-time scaling, our method offers a practical solution for enhancing open-source video models without requiring extensive computational resources for retraining.

📄 PDF Abstract BibTeX arXiv:2603.16271

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Verifier-Free RL for LLMs via Intrinsic Gradient-Norm Reward

2026-05-11 · Xuexiang Wen, Hang Yu, Linchao Zhu, Gaoang Wang arxiv

While Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising post-training paradigm for Large Language Models (LLMs), its dependency on the gold label or domain-specific verifiers limit…

Reinforcement LearningMathematical Reasoning

Reinforcing Consistency in Video MLLMs with Structured Rewards

2026-04-01 · Yihao Quan, Zeru Shi, Jinman Zhao, Ruixiang Tang arxiv

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer from poor visual and temporal grounding: a model may fabricate object e…

Reinforcement Learning

SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards

2026-06-23 · Sheng Xia, Zhengqin Lai, Tianxiang Jiang, Kanghui Tian 외 arxiv

Video MLLMs often struggle with fine-grained spatio-temporal reasoning, sometimes generating correct answers based on irrelevant frames or objects. Although outputting spatio-temporal evidence during reasoning is a promi…

Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction

2026-06-04 · Tianxiang Jiang, Linquan Wu, Sheng Xia, Songze Li 외 arxiv

Video event prediction (VEP) requires models to infer unobserved future states from partial video evidence. Existing video MLLMs usually verbalize intermediate future reasoning in text space: once visual evidence is verb…

Visual Reasoning

WorldReward: Reward Modeling for Camera-Conditioned World Models

2026-09-03 · Yibin Wang, Zehan Wang, Junshu Tang, Zhimin Li 외 hf

Camera-conditioned world models generate interactive videos in which commanded actions should induce the expected scene changes while appearance, geometry, and temporal dynamics remain coherent. Existing rewards assess t…