Time-Division Multiplexing Light Field Display with Learned Coded Aperture
Conventional stereoscopic displays suffer from vergence-accommodation conflict and cause visual fatigue. Integral-imaging-based displays resolve the problem by directly projecting the sub-aperture views of a light field into the eyes using a microlens array or a similar structure. However, such displays have an inherent trade-off between angular and spatial resolutions. In this paper, we propose a novel coded time-division multiplexing technique that projects encoded sub-aperture views to the eyes of a viewer with correct cues for vergence-accommodation reflex. Given sparse light field sub-aperture views, our pipeline can provide a perception of high-resolution refocused images with minimal aliasing by jointly optimizing the sub-aperture views for display and the coded aperture pattern. This is achieved via deep learning in an end-to-end fashion by simulating light transport and image formation with Fourier optics. To our knowledge, this work is among the first that optimize the light field display pipeline with deep learning. We verify our idea with objective image quality metrics (PSNR, SSIM, and LPIPS) and perform an extensive study on various customizable design variables in our display pipeline. Experimental results show that light fields displayed using the proposed technique indeed have higher quality than that of baseline display designs.
Code (0)
등록된 구현이 없습니다.
Tasks
SSIMSimilar Papers 제목 키워드 기반
High-Speed FHD Full-Color Video Computer-Generated Holography
Computer-generated holography (CGH) is a promising technology for next-generation displays. However, generating high-speed, high-quality holographic video requires both high frame rate display and efficient computation, …
Computational EfficiencyNaked Eye Three-dimensional Display System Based on Time-multiplexed Technology
Our group is developing a multi-user eye-tracked 3D display, an evolution of the single-user eye-tracked 3D display that we have already successfully developed. This display utilizes a slanted lenticular setup, where mul…
Enhanced Atmospheric Turbulence Resiliency with Successive Interference Cancellation DSP in Mode Division Multiplexing Free-Space Optical Links
We experimentally demonstrate the enhanced atmospheric turbulence resiliency in a 137.8 Gbit/s/mode mode-division multiplexing free-space optical communication link through the application of a successive interference ca…
Spatial and Wavelength Division Joint Multiplexing System Design for Visible Light Communications
The low-pass characteristics of front-end elements including light-emitting diodes (LEDs) and photodiodes (PDs) limit the transmission data rate of visible light communication (VLC) and Light Fidelity (LiFi) systems. Usi…
Faster than Nyquist Transmission by Non-Orthogonal Time Division Multiplexing of Nyquist Sinc Sequences
One possibility to break down the capacity limit in optical transmission systems are higher spectral efficiencies, enabled by Faster-than-Nyquist signaling. Here we present the utilization of non-orthogonal time division…