paper-with-me

홈 › Papers

LTX-Video: Realtime Video Latent Diffusion

2024-12-30 · Yoav HaCohen, Nisan Chiprut, Benny Brazowski, Daniel Shalem, Dudu Moshe, Eitan Richardson, Eran Levin, Guy Shiran, Nir Zabari, Ori Gordon, Poriya Panet, Sapir Weissbuch, Victor Kulikov, Yaki Bitterman, Zeev Melumian, Ofir Bibi

We introduce LTX-Video, a transformer-based latent diffusion model that adopts a holistic approach to video generation by seamlessly integrating the responsibilities of the Video-VAE and the denoising transformer. Unlike existing methods, which treat these components as independent, LTX-Video aims to optimize their interaction for improved efficiency and quality. At its core is a carefully designed Video-VAE that achieves a high compression ratio of 1:192, with spatiotemporal downscaling of 32 x 32 x 8 pixels per token, enabled by relocating the patchifying operation from the transformer's input to the VAE's input. Operating in this highly compressed latent space enables the transformer to efficiently perform full spatiotemporal self-attention, which is essential for generating high-resolution videos with temporal consistency. However, the high compression inherently limits the representation of fine details. To address this, our VAE decoder is tasked with both latent-to-pixel conversion and the final denoising step, producing the clean result directly in pixel space. This approach preserves the ability to generate fine details without incurring the runtime cost of a separate upsampling module. Our model supports diverse use cases, including text-to-video and image-to-video generation, with both capabilities trained simultaneously. It achieves faster-than-real-time generation, producing 5 seconds of 24 fps video at 768x512 resolution in just 2 seconds on an Nvidia H100 GPU, outperforming all existing models of similar scale. The source code and pre-trained models are publicly available, setting a new benchmark for accessible and scalable video generation.

📄 PDF Abstract BibTeX arXiv:2501.00103

Code (1)

Lightricks/LTX-Video 공식 구현 pytorch

Tasks

DenoisingGPUImage to Video GenerationVideo Generation

Methods 이 논문이 사용한 방법론

Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

IF-MDM: Implicit Face Motion Diffusion Model for High-Fidelity Realtime Talking Head Generation

2024-12-05 · Sejong Yang, Seoung Wug Oh, Yang Zhou, Seon Joo Kim

We introduce a novel approach for high-resolution talking head generation from a single image and audio input. Prior methods using explicit face models, like 3D morphable models (3DMM) and facial landmarks, often fall sh…

DisentanglementTalking Head GenerationVideo Generation

VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation

2023-09-01 · Xin Li, Wenqing Chu, Ye Wu, Weihang Yuan 외

In this paper, we present VideoGen, a text-to-video generation approach, which can generate a high-definition video with high frame fidelity and strong temporal consistency using reference-guided latent diffusion. We lev…

DecoderImage GenerationText to Image GenerationText-to-Image Generation+2

Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition

2024-03-21 · Sihyun Yu, Weili Nie, De-An Huang, Boyi Li 외

Video diffusion models have recently made great progress in generation quality, but are still limited by the high memory and computational requirements. This is because current video diffusion models often attempt to pro…

Video Generation

JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation

2024-09-21 · Hadrien Reynaud, Matthew Baugh, Mischa Dombrowski, Sarah Cechnicka 외

We introduce the Joint Video-Image Diffusion model (JVID), a novel approach to generating high-quality and temporally coherent videos. We achieve this by integrating two diffusion models: a Latent Image Diffusion Model (…

Video Generation

NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesis

2025-09-29 · Yixuan Ren, Hanyu Wang, Hao Chen, Bo He 외 arxiv

We present NeRV-Diffusion, an implicit latent video diffusion model that synthesizes videos via generating neural network weights. The generated weights can be rearranged as the parameters of a convolutional neural netwo…

Video Generation