Papers Image to Video Generation
“Image to Video Generation” 태그가 달린 논문 85편 · 필터 해제
GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion
Estimating accurate and temporally consistent 3D human geometry from videos is a challenging problem in computer vision. Existing methods, primarily optimized for single images, often suffer from temporal inconsistencies…
Depth EstimationImage to Video GenerationVideo GenerationATI: Any Trajectory Instruction for Controllable Video Generation
We propose a unified framework for motion control in video generation that seamlessly integrates camera movement, object-level translation, and fine-grained local motion using trajectory-based inputs. In contrast to prio…
Image to Video GenerationVideo GenerationDynamic-I2V: Exploring Image-to-Video Generaion Models via Multimodal LLM
Recent advancements in image-to-video (I2V) generation have shown promising performance in conventional scenarios. However, these methods still encounter significant challenges when dealing with complex scenes that requi…
Image to Video GenerationVideo GenerationMotionPro: A Precise Motion Controller for Image-to-Video Generation
Animating images with interactive motion control has garnered popularity for image-to-video (I2V) generation. Modern approaches typically rely on large Gaussian kernels to extend motion trajectories as condition without …
DenoisingImage to Video GenerationMotion SynthesisVideo Denoising+1Hunyuan-Game: Industrial-grade Intelligent Game Creation Model
Intelligent game creation represents a transformative advancement in game development, utilizing generative artificial intelligence to dynamically generate and enhance game content. Despite notable progress in generative…
Image GenerationImage to Video GenerationSuper-ResolutionText to Image Generation+3LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
In recent years, large-scale pre-trained diffusion transformer models have made significant progress in video generation. While current DiT models can produce high-definition, high-frame-rate, and highly diverse videos, …
Image to Video GenerationVideo GenerationMG-Gen: Single Image to Motion Graphics Generation with Layer Decomposition
General image-to-video generation methods often produce suboptimal animations that do not meet the requirements of animated graphics, as they lack active text motion and exhibit object distortion. Also, code-based animat…
Code GenerationImage to Video GenerationVideo GenerationEvery Painting Awakened: A Training-free Framework for Painting-to-Animation Generation
We introduce a training-free framework specifically designed to bring real-world static paintings to life through image-to-video (I2V) synthesis, addressing the persistent challenge of aligning these motions with textual…
Image to Video GenerationTowards Physically Plausible Video Generation via VLM Planning
Video diffusion models (VDMs) have advanced significantly in recent years, enabling the generation of highly realistic videos and drawing the attention of the community in their potential as world simulators. However, de…
Image to Video GenerationVideo GenerationEvAnimate: Event-conditioned Image-to-Video Generation for Human Animation
Conditional human animation traditionally animates static reference images using pose-based motion cues extracted from video data. However, these video-derived cues often suffer from low temporal resolution, motion blur,…
BenchmarkingData AugmentationHuman AnimationImage Animation+2MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidance
Recent advances in video generation have led to remarkable improvements in visual quality and temporal coherence. Upon this, trajectory-controllable video generation has emerged to enable precise object motion control th…
Image to Video GenerationObjectVideo GenerationStep-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Model
We present Step-Video-TI2V, a state-of-the-art text-driven image-to-video generation model with 30B parameters, capable of generating videos up to 102 frames based on both text and image inputs. We build Step-Video-TI2V-…
Image to Video GenerationVideo GenerationI2V3D: Controllable image-to-video generation with 3D guidance
We present I2V3D, a novel framework for animating static images into dynamic videos with precise 3D control, leveraging the strengths of both 3D geometry guidance and advanced generative models. Our approach combines the…
3D geometryImage to Video GenerationVideo GenerationDualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance
Accurate and high-fidelity driving scene reconstruction demands the effective utilization of comprehensive scene information as conditional inputs. Existing methods predominantly rely on 3D bounding boxes and BEV road ma…
3D Object DetectionBEV SegmentationDenoisingImage to Video Generation+2Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think
Image-to-Video (I2V) generation aims to synthesize a video clip according to a given image and condition (e.g., text). The key challenge of this task lies in simultaneously generating natural motions while preserving the…
DenoisingImage to Video GenerationVideo GenerationObject-Centric Image to Video Generation with Language Guidance
Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events. Object-centric models, with structured latent spaces, have shown promise in modeling object…
Image to Video GenerationObjectVideo GenerationRealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control
Recent advancements in camera-trajectory-guided image-to-video generation offer higher precision and better support for complex camera control compared to text-based approaches. However, they also introduce significant u…
3D Scene ReconstructionDepth EstimationImage to Video GenerationVideo GenerationVidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generation
Recent image-to-video generation methods have demonstrated success in enabling control over one or two visual elements, such as camera motion or object motion. However, these methods are unable to offer control over mult…
Image to Video GenerationObjectOptical Flow EstimationVideo GenerationMagic 1-For-1: Generating One Minute Video Clips within One Minute
In this technical report, we present Magic 1-For-1 (Magic141), an efficient video generation model with optimized memory consumption and inference latency. The key idea is simple: factorize the text-to-video generation t…
Image GenerationImage to Video GenerationText to Image GenerationText-to-Image Generation+2MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation
This paper presents a method that allows users to design cinematic video shots in the context of image-to-video generation. Shot design, a critical aspect of filmmaking, involves meticulously planning both camera movemen…
Image to Video GenerationVideo EditingVideo Generation