paper-with-me

홈 › Papers

3DTV: A Feedforward Interpolation Network for Real-Time View Synthesis

2026-04-13 · Stefan Schulz, Fernando Edelstein, Hannah Dröge, Matthias B. Hullin, Markus Plack arxiv

Real-time free-viewpoint rendering requires balancing multi-camera redundancy with the latency constraints of interactive applications. We address this challenge by combining lightweight geometry with learning and propose 3DTV, a feedforward network for real-time sparse-view interpolation. A Delaunay-based triplet selection ensures angular coverage for each target view. Building on this, we introduce a pose-aware depth module that estimates a coarse-to-fine depth pyramid, enabling efficient feature reprojection and occlusion-aware blending. Unlike methods that require scene-specific optimization, 3DTV runs feedforward without retraining, making it practical for AR/VR, telepresence, and interactive applications. Our experiments on challenging multi-view video datasets demonstrate that 3DTV consistently achieves a strong balance of quality and efficiency, outperforming recent real-time novel-view baselines. Crucially, 3DTV avoids explicit proxies, enabling robust rendering across diverse scenes. This makes it a practical solution for low-latency multi-view streaming and interactive rendering. Project Page: https://stefanmschulz.github.io/3DTV_webpage/

📄 PDF Abstract BibTeX arXiv:2604.11211

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images

2026-02-27 · Junhwa Hur, Charles Herrmann, Songyou Peng, Philipp Henzler 외 arxiv

Dense 4D reconstruction from unposed images remains a critical challenge, with current methods relying on slow test-time optimization or fragmented, task-specific feedforward models. We introduce UFO-4D, a unified feedfo…

Camera Pose Estimation

A new dataset and comparison for multi-camera frame synthesis

2025-08-12 · Conall Daly, Anil Kokaram arxiv

Many methods exist for frame synthesis in image sequences but can be broadly categorised into frame interpolation and view synthesis techniques. Fundamentally, both frame interpolation and view synthesis tackle the same …

Depth Estimation

A Multi-user Oriented Live Free-viewpoint Video Streaming System Based On View Interpolation

2021-12-20 · Jingchuan Hu, Shuai Guo, Kai Zhou, Yu Dong 외

As an important application form of immersive multimedia services, free-viewpoint video(FVV) enables users with great immersive experience by strong interaction. However, the computational complexity of virtual view synt…

See360: Novel Panoramic View Interpolation

2024-01-07 · Zhi-Song Liu, Marie-Paule Cani, Wan-Chi Siu

We present See360, which is a versatile and efficient framework for 360 panoramic view interpolation using latent space viewpoint estimation. Most of the existing view rendering approaches only focus on indoor or synthet…

Viewpoint Estimation

Sharp Monocular View Synthesis in Less Than a Second

2025-12-11 · Lars Mescheder, Wei Dong, Shiwei Li, Xuyang Bai 외 arxiv

We present SHARP, an approach to photorealistic view synthesis from a single image. Given a single photograph, SHARP regresses the parameters of a 3D Gaussian representation of the depicted scene. This is done in less th…

Zero-shot Generalization