paper-with-me

홈 › Papers

Non-Adversarial Video Synthesis with Learned Priors

2020-03-21 · CVPR 2020 6 · Abhishek Aich, Akash Gupta, Rameswar Panda, Rakib Hyder, M. Salman Asif, Amit K. Roy-Chowdhury

Most of the existing works in video synthesis focus on generating videos using adversarial learning. Despite their success, these methods often require input reference frame or fail to generate diverse videos from the given data distribution, with little to no uniformity in the quality of videos that can be generated. Different from these methods, we focus on the problem of generating videos from latent noise vectors, without any reference input frames. To this end, we develop a novel approach that jointly optimizes the input latent space, the weights of a recurrent neural network and a generator through non-adversarial learning. Optimizing for the input latent space along with the network weights allows us to generate videos in a controlled environment, i.e., we can faithfully generate all videos the model has seen during the learning process as well as new unseen videos. Extensive experiments on three challenging and diverse datasets well demonstrate that our approach generates superior quality videos compared to the existing state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2003.09565

Code (1)

abhishekaich27/Navsynth 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos

2023-03-29 · CVPR 2023 1 · Kun Su, Kaizhi Qian, Eli Shlizerman, Antonio Torralba 외

Modeling sounds emitted from physical object interactions is critical for immersive perceptual experiences in real and virtual worlds. Traditional methods of impact sound synthesis use physics simulation to obtain a set …

ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models

2023-12-03 · CVPR 2024 1 · Jeong-gi Kwak, Erqun Dong, Yuhe Jin, Hanseok Ko 외

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new …

Novel View SynthesisObject

Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos

2025-05-19 · Ruoyu Wang, Yi Ma, Shenghua Gao

Currently almost all state-of-the-art novel view synthesis and reconstruction models rely on calibrated cameras or additional geometric priors for training. These prerequisites significantly limit their applicability to …

3D geometryCamera Pose EstimationNovel View SynthesisPose Estimation

Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categories

2022-11-07 · CVPR 2023 1 · Samarth Sinha, Roman Shapovalov, Jeremy Reizenstein, Ignacio Rocco 외

Obtaining photorealistic reconstructions of objects from sparse views is inherently ambiguous and can only be achieved by learning suitable reconstruction priors. Earlier works on sparse rigid object reconstruction succe…

3D Reconstruction4D reconstructionBenchmarkingNeRF+1

Searching Priors Makes Text-to-Video Synthesis Better

2024-06-05 · Haoran Cheng, Liang Peng, Linxuan Xia, Yuepeng Hu 외

Significant advancements in video diffusion models have brought substantial progress to the field of text-to-video (T2V) synthesis. However, existing T2V synthesis model struggle to accurately generate complex motion dyn…

GPU