paper-with-me

홈 › Papers

I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strength

2024-11-10 · Wanquan Feng, Jiawei Liu, Pengqi Tu, Tianhao Qi, Mingzhen Sun, Tianxiang Ma, Songtao Zhao, Siyu Zhou, Qian He

Video generation technologies are developing rapidly and have broad potential applications. Among these technologies, camera control is crucial for generating professional-quality videos that accurately meet user expectations. However, existing camera control methods still suffer from several limitations, including control precision and the neglect of the control for subject motion dynamics. In this work, we propose I2VControl-Camera, a novel camera control method that significantly enhances controllability while providing adjustability over the strength of subject motion. To improve control precision, we employ point trajectory in the camera coordinate system instead of only extrinsic matrix information as our control signal. To accurately control and adjust the strength of subject motion, we explicitly model the higher-order components of the video trajectory expansion, not merely the linear terms, and design an operator that effectively represents the motion strength. We use an adapter architecture that is independent of the base model structure. Experiments on static and dynamic scenes show that our framework outperformances previous methods both quantitatively and qualitatively. The project page is: https://wanquanf.github.io/I2VControlCamera .

📄 PDF Abstract BibTeX arXiv:2411.06525

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Methods 이 논문이 사용한 방법론

BASE 설명 없음
Adapter 설명 없음

Similar Papers 제목 키워드 기반

AVControl: Efficient Framework for Training Audio-Visual Controls

2026-03-25 · Matan Ben-Yosef, Tavi Halperin, Naomi Ken Korem, Mohammad Salama 외 arxiv

Controlling video and audio generation requires diverse modalities, from depth and pose to camera trajectories and audio transformations, yet existing approaches either train a single monolithic model for a fixed set of …

Audio Generation

BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layout

2023-08-03 · Kairui Yang, Enhui Ma, Jibin Peng, Qing Guo 외

Using synthesized images to boost the performance of perception models is a long-standing research challenge in computer vision. It becomes more eminent in visual-centric autonomous driving systems with multi-view camera…

Autonomous DrivingBEV SegmentationForeground SegmentationSegmentation

CameraCtrl: Enabling Camera Control for Text-to-Video Generation

2024-04-02 · Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein 외

Controllability plays a crucial role in video generation since it allows users to create desired content. However, existing models largely overlooked the precise control of camera pose that serves as a cinematic language…

Text-to-Video GenerationVideo Generation

Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation

2026-01-15 · Dong-Yu Chen, Yixin Guo, Shuojin Yang, Tai-Jiang Mu 외 arxiv

Camera control has been extensively studied in conditioned video generation; however, performing precisely altering the camera trajectories while faithfully preserving the video content remains a challenging task. The ma…

Video Generation

GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control

2025-03-05 · CVPR 2025 1 · Xuanchi Ren, Tianchang Shen, Jiahui Huang, Huan Ling 외

We present GEN3C, a generative video model with precise Camera Control and temporal 3D Consistency. Prior video models already generate realistic videos, but they tend to leverage little 3D information, leading to incons…

Novel View SynthesisVideo Generation