paper-with-me

홈 › Papers

Volumetric Isosurface Rendering with Deep Learning-Based Super-Resolution

2019-06-15 · Sebastian Weiss, Mengyu Chu, Nils Thuerey, Rüdiger Westermann

Rendering an accurate image of an isosurface in a volumetric field typically requires large numbers of data samples. Reducing the number of required samples lies at the core of research in volume rendering. With the advent of deep learning networks, a number of architectures have been proposed recently to infer missing samples in multi-dimensional fields, for applications such as image super-resolution and scan completion. In this paper, we investigate the use of such architectures for learning the upscaling of a low-resolution sampling of an isosurface to a higher resolution, with high fidelity reconstruction of spatial detail and shading. We introduce a fully convolutional neural network, to learn a latent representation generating a smooth, edge-aware normal field and ambient occlusions from a low-resolution normal and depth field. By adding a frame-to-frame motion loss into the learning stage, the upscaling can consider temporal variations and achieves improved frame-to-frame coherence. We demonstrate the quality of the network for isosurfaces which were never seen during training, and discuss remote and in-situ visualization as well as focus+context visualization as potential applications

📄 PDF Abstract BibTeX arXiv:1906.06520

Code (1)

shamanDevel/IsosurfaceSuperresolution 공식 구현 pytorch

Tasks

Deep LearningImage Super-ResolutionSuper-Resolution

Similar Papers 제목 키워드 기반

Deep Learning based Super-Resolution for Medical Volume Visualization with Direct Volume Rendering

2022-10-14 · Sudarshan Devkota, Sumanta Pattanaik

Modern-day display systems demand high-quality rendering. However, rendering at higher resolution requires a large number of data samples and is computationally expensive. Recent advances in deep learning-based image and…

Super-ResolutionVideo Super-Resolution

Neural Volume Super-Resolution

2022-12-09 · Yuval Bahat, Yuxuan Zhang, Hendrik Sommerhoff, Andreas Kolb 외

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in…

Super-Resolution

SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling

2025-03-27 · Xianglong He, Zi-Xin Zou, Chia-Hao Chen, Yuan-Chen Guo 외

Creating high-fidelity 3D meshes with arbitrary topology, including open surfaces and complex interiors, remains a significant challenge. Existing implicit field methods often require costly and detail-degrading watertig…

3D Shape Generation3D Shape Modeling3D Shape Representation

Differentiable Surface Rendering via Non-Differentiable Sampling

2021-08-10 · ICCV 2021 10 · Forrester Cole, Kyle Genova, Avneesh Sud, Daniel Vlasic 외

We present a method for differentiable rendering of 3D surfaces that supports both explicit and implicit representations, provides derivatives at occlusion boundaries, and is fast and simple to implement. The method firs…

Inverse RenderingNeRF

Mixture of Volumetric Primitives for Efficient Neural Rendering

2021-03-02 · Stephen Lombardi, Tomas Simon, Gabriel Schwartz, Michael Zollhoefer 외

Real-time rendering and animation of humans is a core function in games, movies, and telepresence applications. Existing methods have a number of drawbacks we aim to address with our work. Triangle meshes have difficulty…

Neural Rendering