paper-with-me

Papers

Geometry-Aware Graph Transforms for Light Field Compact Representation

2019-03-08 · Mira Rizkallah, Xin Su, Thomas Maugey, Christine Guillemot

The paper addresses the problem of energy compaction of dense 4D light fields by designing geometry-aware local graph-based transforms. Local graphs are constructed on super-rays that can be seen as a grouping of spatially and geometry-dependent angularly correlated pixels. Both non separable and separable transforms are considered. Despite the local support of limited size defined by the super-rays, the Laplacian matrix of the non separable graph remains of high dimension and its diagonalization to compute the transform eigen vectors remains computationally expensive. To solve this problem, we then perform the local spatio-angular transform in a separable manner. We show that when the shape of corresponding super-pixels in the different views is not isometric, the basis functions of the spatial transforms are not coherent, resulting in decreased correlation between spatial transform coefficients. We hence propose a novel transform optimization method that aims at preserving angular correlation even when the shapes of the super-pixels are not isometric. Experimental results show the benefit of the approach in terms of energy compaction. A coding scheme is also described to assess the rate-distortion perfomances of the proposed transforms and is compared to state of the art encoders namely HEVC and JPEG Pleno VM 1.1.

📄 PDF Abstract BibTeX arXiv:1903.03556

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Prediction and Sampling with Local Graph Transforms for Quasi-Lossless Light Field Compression

2019-03-08 · Mira Rizkallah, Thomas Maugey, Christine Guillemot

Graph-based transforms have been shown to be powerful tools in terms of image energy compaction. However, when the support increases to best capture signal dependencies, the computation of the basis functions becomes rap…

Geo-NI: Geometry-aware Neural Interpolation for Light Field Rendering

2022-06-20 · Gaochang Wu, Yuemei Zhou, Yebin Liu, Lu Fang 외

In this paper, we present a Geometry-aware Neural Interpolation (Geo-NI) framework for light field rendering. Previous learning-based approaches either rely on the capability of neural networks to perform direct interpol…

Novel View Synthesis

Ray Space Features for Plenoptic Structure-From-Motion

2017-10-01 · ICCV 2017 10 · Yingliang Zhang, Peihong Yu, Wei Yang, Yuanxi Ma 외

Traditional Structure-from-Motion (SfM) uses images captured by cameras as inputs. In this paper, we explore using light fields captured by plenoptic cameras or camera arrays as inputs. We call this solution plenoptic Sf…

SOAF: Scene Occlusion-aware Neural Acoustic Field

2024-07-02 · Huiyu Gao, Jiahao Ma, David Ahmedt-Aristizabal, Chuong Nguyen 외

This paper tackles the problem of novel view audio-visual synthesis along an arbitrary trajectory in an indoor scene, given the audio-video recordings from other known trajectories of the scene. Existing methods often ov…

Audio Generation

GaNI: Global and Near Field Illumination Aware Neural Inverse Rendering

2024-03-22 · Jiaye Wu, Saeed Hadadan, Geng Lin, Matthias Zwicker 외

In this paper, we present GaNI, a Global and Near-field Illumination-aware neural inverse rendering technique that can reconstruct geometry, albedo, and roughness parameters from images of a scene captured with co-locate…

Inverse Rendering