paper-with-me

Papers

Visual Acuity Consistent Foveated Rendering towards Retinal Resolution

2025-03-30 · Zhi Zhang, Meng Gai, Sheng Li

Prior foveated rendering methods often suffer from a limitation where the shading load escalates with increasing display resolution, leading to decreased efficiency, particularly when dealing with retinal-level resolutions. To tackle this challenge, we begin with the essence of the human visual system (HVS) perception and present visual acuity-consistent foveated rendering (VaFR), aiming to achieve exceptional rendering performance at retinal-level resolutions. Specifically, we propose a method with a novel log-polar mapping function derived from the human visual acuity model, which accommodates the natural bandwidth of the visual system. This mapping function and its associated shading rate guarantee a consistent output of rendering information, regardless of variations in the display resolution of the VR HMD. Consequently, our VaFR outperforms alternative methods, improving rendering speed while preserving perceptual visual quality, particularly when operating at retinal resolutions. We validate our approach using both the rasterization and ray-casting rendering pipelines. We also validate our approach using different binocular rendering strategies for HMD devices. In diverse testing scenarios, our approach delivers better perceptual visual quality than prior foveated rendering while achieving an impressive speedup of 6.5$\times$-9.29$\times$ for deferred rendering of 3D scenarios and an even more powerful speedup of 10.4$\times$-16.4$\times$ for ray-casting at retinal resolution. Additionally, our approach significantly enhances the rendering performance of binocular 8K path tracing, achieving smooth frame rates.

📄 PDF Abstract BibTeX arXiv:2503.23410

Code (0)

등록된 구현이 없습니다.

Tasks

8k

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Towards Understanding Depth Perception in Foveated Rendering

2025-01-28 · Sophie Kergaßner, Taimoor Tariq, Piotr Didyk

The true vision for real-time virtual and augmented reality is reproducing our visual reality in its entirety on immersive displays. To this end, foveated rendering leverages the limitations of spatial acuity in human pe…

Foveation

Toward Standardized Classification of Foveated Displays

2019-05-03 · Josef Spjut, Ben Boudaoud, Jonghyun Kim, Trey Greer 외

Emergent in the field of head mounted display design is a desire to leverage the limitations of the human visual system to reduce the computation, communication, and display workload in power and form-factor constrained …

ClassificationFoveationGeneral Classification

Foveated Retinotopy Improves Classification and Localization in CNNs

2024-02-23 · Jean-Nicolas Jérémie, Emmanuel Daucé, Laurent U Perrinet

From a falcon detecting prey to humans recognizing faces, many species exhibit extraordinary abilities in rapid visual localization and classification. These are made possible by a specialized retinal region called the f…

ClassificationImage Categorizationimage-classificationImage Classification+2

FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Reality

2024-12-12 · Wenxuan Liu, Monde Duinkharjav, Qi Sun, Sai Qian Zhang

Leveraging real-time eye-tracking, foveated rendering optimizes hardware efficiency and enhances visual quality virtual reality (VR). This approach leverages eye-tracking techniques to determine where the user is looking…

Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

2026-08-17 · Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani, Ulas Bagci 외 arxiv

Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language models (MLLMs), given the same foveated input, search as humans do be…