paper-with-me

홈 › Papers

Casual 6-DoF: free-viewpoint panorama using a handheld 360 camera

2022-03-31 · Rongsen Chen, Fang-Lue Zhang, Simon Finnie, Andrew Chalmers, Teahyun Rhee

Six degrees-of-freedom (6-DoF) video provides telepresence by enabling users to move around in the captured scene with a wide field of regard. Compared to methods requiring sophisticated camera setups, the image-based rendering method based on photogrammetry can work with images captured with any poses, which is more suitable for casual users. However, existing image-based rendering methods are based on perspective images. When used to reconstruct 6-DoF views, it often requires capturing hundreds of images, making data capture a tedious and time-consuming process. In contrast to traditional perspective images, 360{\deg} images capture the entire surrounding view in a single shot, thus, providing a faster capturing process for 6-DoF view reconstruction. This paper presents a novel method to provide 6-DoF experiences over a wide area using an unstructured collection of 360{\deg} panoramas captured by a conventional 360{\deg} camera. Our method consists of 360{\deg} data capturing, novel depth estimation to produce a high-quality spherical depth panorama, and high-fidelity free-viewpoint generation. We compared our method against state-of-the-art methods, using data captured in various environments. Our method shows better visual quality and robustness in the tested scenes.

📄 PDF Abstract BibTeX arXiv:2203.16756

Code (0)

등록된 구현이 없습니다.

Tasks

Depth Estimation

Similar Papers 제목 키워드 기반

Casual Stereoscopic Panorama Stitching

2015-06-01 · CVPR 2015 6 · Fan Zhang, Feng Liu

This paper presents a method for stitching stereoscopic panoramas from stereo images casually taken using a stereo camera. This method addresses three challenges of stereoscopic image stitching: how to handle parallax, h…

Image Stitching

VidPanos: Generative Panoramic Videos from Casual Panning Videos

2024-10-17 · Jingwei Ma, Erika Lu, Roni Paiss, Shiran Zada 외

Panoramic image stitching provides a unified, wide-angle view of a scene that extends beyond the camera's field of view. Stitching frames of a panning video into a panoramic photograph is a well-understood problem for st…

Image StitchingVideo Generation

See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpainting

2025-10-30 · Dongyue Lu, Ao Liang, Tianxin Huang, Xiao Fu 외 arxiv

Immersive applications call for synthesizing spatiotemporal 4D content from casual videos without costly 3D supervision. Existing video-to-4D methods typically rely on manually annotated camera poses, which are labor-int…

Trajectory PredictionVideo GenerationVideo Inpainting

FreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifold

2021-09-20 · Thomas Leimkühler, George Drettakis

Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provi…

3D ReconstructionMixed RealityNovel View Synthesis

PanORama: Multiview Consistent Panoptic Segmentation in Operating Rooms

2026-03-20 · Tuna Gürbüz, Ege Özsoy, Tony Danjun Wang, Nassir Navab arxiv

Operating rooms (ORs) are cluttered, dynamic, highly occluded environments, where reliable spatial understanding is essential for situational awareness during complex surgical workflows. Achieving spatial understanding f…

Panoptic Segmentation