paper-with-me

홈 › Papers

Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models

2026-01-07 · Zitong Huang, Kaidong Zhang, Yukang Ding, Chao Gao, Rui Ding, Ying Chen, Wangmeng Zuo arxiv

Aligning text-to-video diffusion models with human preferences is crucial for generating high-quality videos. Existing Direct Preference Otimization (DPO) methods rely on multi-sample ranking and task-specific critic models, which is inefficient and often yields ambiguous global supervision. To address these limitations, we propose LocalDPO, a novel post-training framework that constructs localized preference pairs from real videos and optimizes alignment at the spatio-temporal region level. We design an automated pipeline to efficiently collect preference pair data that generates preference pairs with a single inference per prompt, eliminating the need for external critic models or manual annotation. Specifically, we treat high-quality real videos as positive samples and generate corresponding negatives by locally corrupting them with random spatio-temporal masks and restoring only the masked regions using the frozen base model. During training, we introduce a region-aware DPO loss that restricts preference learning to corrupted areas for rapid convergence. Experiments on Wan2.1 and CogVideoX demonstrate that LocalDPO consistently improves video fidelity, temporal coherence and human preference scores over other post-training approaches, establishing a more efficient and fine-grained paradigm for video generator alignment.The code is available at https://github.com/1170300714/Local-DPO.

📄 PDF Abstract BibTeX arXiv:2601.04068

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DECOLLAGE: 3D Detailization by Controllable, Localized, and Learned Geometry Enhancement

2024-09-10 · Qimin Chen, Zhiqin Chen, Vladimir G. Kim, Noam Aigerman 외

We present a 3D modeling method which enables end-users to refine or detailize 3D shapes using machine learning, expanding the capabilities of AI-assisted 3D content creation. Given a coarse voxel shape (e.g., one produc…

Crafting Parts for Expressive Object Composition

2024-06-14 · Harsh Rangwani, Aishwarya Agarwal, Kuldeep Kulkarni, R. Venkatesh Babu 외

Text-to-image generation from large generative models like Stable Diffusion, DALLE-2, etc., have become a common base for various tasks due to their superior quality and extensive knowledge bases. As image composition an…

DenoisingImage GenerationObjectText to Image Generation+1

GaussianLens: Localized High-Resolution Reconstruction via On-Demand Gaussian Densification

2025-09-29 · Yijia Weng, Zhicheng Wang, Songyou Peng, Saining Xie 외 arxiv

We perceive our surroundings with an active focus, paying more attention to regions of interest, such as the shelf labels in a grocery store. When it comes to scene reconstruction, this human perception trait calls for s…

Describe Anything: Detailed Localized Image and Video Captioning

2025-04-22 · Long Lian, Yifan Ding, Yunhao Ge, Sifei Liu 외

Generating detailed and accurate descriptions for specific regions in images and videos remains a fundamental challenge for vision-language models. We introduce the Describe Anything Model (DAM), a model designed for det…

SentenceVideo Captioning

Joint2Human: High-quality 3D Human Generation via Compact Spherical Embedding of 3D Joints

2023-12-14 · CVPR 2024 1 · Muxin Zhang, Qiao Feng, Zhuo Su, Chao Wen 외

3D human generation is increasingly significant in various applications. However, the direct use of 2D generative methods in 3D generation often results in losing local details, while methods that reconstruct geometry fr…

3D Generation