paper-with-me

Papers

Configurable Holography: Towards Display and Scene Adaptation

2024-03-24 · Yicheng Zhan, Liang Shi, Wojciech Matusik, Qi Sun, Kaan Akşit

Emerging learned holography approaches have enabled faster and high-quality hologram synthesis, setting a new milestone toward practical holographic displays. However, these learned models require training a dedicated model for each set of display-scene parameters. To address this shortcoming, our work introduces a highly configurable learned model structure, synthesizing 3D holograms interactively while supporting diverse display-scene parameters. Our family of models relying on this structure can be conditioned continuously for varying novel scene parameters, including input images, propagation distances, volume depths, peak brightnesses, and novel display parameters of pixel pitches and wavelengths. Uniquely, our findings unearth a correlation between depth estimation and hologram synthesis tasks in the learning domain, leading to a learned model that unlocks accurate 3D hologram generation from 2D images across varied display-scene parameters. We validate our models by synthesizing high-quality 3D holograms in simulations and also verify our findings with two different holographic display prototypes. Moreover, our family of models can synthesize holograms with a 2x speed-up compared to the state-of-the-art learned holography approaches in the literature.

📄 PDF Abstract BibTeX arXiv:2405.01558

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationKnowledge Distillation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

High-contrast, speckle-free, true 3D holography via binary CGH optimization

2022-01-07 · Byounghyo Lee, Dongyeon Kim, Seungjae Lee, Chun Chen 외

Holography is a promising approach to implement the three-dimensional (3D) projection beyond the present two-dimensional technology. True 3D holography requires abilities of arbitrary 3D volume projection with high-axial…

3D HolographyQuantizationVocal Bursts Intensity Prediction

Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators

2022-05-05 · Suyeon Choi, Manu Gopakumar, YiFan, Peng 외

Holographic near-eye displays offer unprecedented capabilities for virtual and augmented reality systems, including perceptually important focus cues. Although artificial intelligence--driven algorithms for computer-gene…

Sparse deep computer-generated holography for optical microscopy

2021-11-30 · NeurIPS Workshop Deep_Invers 2021 12 · Alex Liu, Yi Xue, Laura Waller

Computer-generated holography (CGH) has broad applications such as direct-view display, virtual and augmented reality, as well as optical microscopy. CGH usually utilizes a spatial light modulator that displays a compute…

Learned holographic light transport

2021-08-01 · Koray Kavaklı, Hakan Urey, Kaan Akşit

Computer-Generated Holography (CGH) algorithms often fall short in matching simulations with results from a physical holographic display. Our work addresses this mismatch by learning the holographic light transport in ho…

Realistic Defocus Blur for Multiplane Computer-Generated Holography

2022-05-14 · Koray Kavaklı, Yuta Itoh, Hakan Urey, Kaan Akşit

This paper introduces a new multiplane CGH computation method to reconstruct artefact-free high-quality holograms with natural-looking defocus blur. Our method introduces a new targeting scheme and a new loss function. W…

3D Holography