paper-with-me

홈 › Papers

VideoScore2: Think before You Score in Generative Video Evaluation

2025-09-26 · Xuan He, Dongfu Jiang, Ping Nie, Minghao Liu, Zhengxuan Jiang, Mingyi Su, Wentao Ma, Junru Lin, Chun Ye, Yi Lu, Keming Wu, Benjamin Schneider, Quy Duc Do, Zhuofeng Li, Yiming Jia, Yuxuan Zhang, Guo Cheng, Haozhe Wang, Wangchunshu Zhou, Qunshu Lin, Yuanxing Zhang, Ge Zhang, Wenhao Huang, Wenhu Chen arxiv

Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quality, semantic alignment, and physical consistency. Existing evaluators and reward models are limited to single opaque scores, lack interpretability, or provide only coarse analysis, making them insufficient for capturing the comprehensive nature of video quality assessment. We present VideoScore2, a multi-dimensional, interpretable, and human-aligned framework that explicitly evaluates visual quality, text-to-video alignment, and physical/common-sense consistency while producing detailed chain-of-thought rationales. Our model is trained on a large-scale dataset VideoFeedback2 containing 27,168 human-annotated videos with both scores and reasoning traces across three dimensions, using a two-stage pipeline of supervised fine-tuning followed by reinforcement learning with Group Relative Policy Optimization (GRPO) to enhance analytical robustness. Extensive experiments demonstrate that VideoScore2 achieves superior performance with 44.35 (+5.94) accuracy on our in-domain benchmark VideoScore-Bench-v2 and 50.37 (+4.32) average performance across four out-of-domain benchmarks (VideoGenReward-Bench, VideoPhy2, etc), while providing interpretable assessments that bridge the gap between evaluation and controllable generation through effective reward modeling for Best-of-N sampling. Project Page: https://tiger-ai-lab.github.io/VideoScore2/

📄 PDF Abstract BibTeX arXiv:2509.22799

Code (0)

등록된 구현이 없습니다.

Tasks

Video Quality AssessmentText-to-Video GenerationReinforcement LearningVideo Alignment

Similar Papers 제목 키워드 기반

VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

2024-06-21 · Xuan He, Dongfu Jiang, Ge Zhang, Max Ku 외

The recent years have witnessed great advances in video generation. However, the development of automatic video metrics is lagging significantly behind. None of the existing metric is able to provide reliable scores over…

Video GenerationVideo Quality Assessment

4Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion

2024-12-05 · CVPR 2025 1 · Chaoyang Wang, Peiye Zhuang, Tuan Duc Ngo, Willi Menapace 외

We propose 4Real-Video, a novel framework for generating 4D videos, organized as a grid of video frames with both time and viewpoint axes. In this grid, each row contains frames sharing the same timestep, while each colu…

CultureScore: Evaluating Cultural Faithfulness in Video Generation Models

2026-06-05 · Anku Rani, Wei Dai, Shravan Nayak, Pattie Maes 외 arxiv

As video generation models like Veo 3.1 and LTX-2 advance, their ability to accurately represent diverse global cultures remains a critical yet understudied frontier. Current metrics, such as VideoScore, only measure vis…

Video Generation

VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation

2024-12-30 · Jiazheng Xu, Yu Huang, Jiale Cheng, Yuanming Yang 외

We present a general strategy to aligning visual generation models -- both image and video generation -- with human preference. To start with, we build VisionReward -- a fine-grained and multi-dimensional reward model. W…

Video GenerationVideo Quality Assessment

AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation

2025-07-02 · Xiao Liu, Jiawei Zhang arxiv

The rapid advancement of AI-generated video models has created a pressing need for robust and interpretable evaluation frameworks. Existing metrics are limited to producing numerical scores without explanatory comments, …

Video Generation