paper-with-me

Papers

Unifying Light Field Perception with Field of Parallax

2025-03-02 · Fei Teng, Buyin Deng, Boyuan Zheng, Kai Luo, Kunyu Peng, Jiaming Zhang, Kailun Yang

Field of Parallax (FoP)}, a spatial field that distills the common features from different LF representations to provide flexible and consistent support for multi-task learning. FoP is built upon three core features--projection difference, adjacency divergence, and contextual consistency--which are essential for cross-task adaptability. To implement FoP, we design a two-step angular adapter: the first step captures angular-specific differences, while the second step consolidates contextual consistency to ensure robust representation. Leveraging the FoP-based representation, we introduce the LFX framework, the first to handle arbitrary LF representations seamlessly, unifying LF multi-task vision. We evaluated LFX across three different tasks, achieving new state-of-the-art results, compared with previous task-specific architectures: 84.74% in mIoU for semantic segmentation on UrbanLF, 0.84% in AP for object detection on PKU, and 0.030 in MAE and 0.026 in MAE for salient object detection on Duftv2 and PKU, respectively. The source code will be made publicly available at https://github.com/warriordby/LFX.

📄 PDF Abstract BibTeX arXiv:2503.00747

Code (1)

warriordby/lfx 공식 구현

Tasks

Multi-Task Learningobject-detectionObject DetectionSalient Object DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

MAE 설명 없음

Similar Papers 제목 키워드 기반

Light Field Denoising via Anisotropic Parallax Analysis in a CNN Framework

2018-05-31 · Jie Chen, Junhui Hou, Lap-Pui Chau

Light field (LF) cameras provide perspective information of scenes by taking directional measurements of the focusing light rays. The raw outputs are usually dark with additive camera noise, which impedes subsequent proc…

Denoising

Learning Light Field Angular Super-Resolution via a Geometry-Aware Network

2020-02-26 · Jing Jin, Junhui Hou, Hui Yuan, Sam Kwong

The acquisition of light field images with high angular resolution is costly. Although many methods have been proposed to improve the angular resolution of a sparsely-sampled light field, they always focus on the light f…

Depth EstimationSuper-Resolution

Inferring Light Fields From Shadows

2018-06-01 · CVPR 2018 6 · Manel Baradad, Vickie Ye, Adam B. Yedidia, Frédo Durand 외

We present a method for inferring a 4D light field of a hidden scene from 2D shadows cast by a known occluder on a diffuse wall. We do this by determining how light naturally reflected off surfaces in the hidden scene in…

Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization

2020-04-05 · CVPR 2020 6 · Jing Jin, Junhui Hou, Jie Chen, Sam Kwong

Light field (LF) images acquired by hand-held devices usually suffer from low spatial resolution as the limited sampling resources have to be shared with the angular dimension. LF spatial super-resolution (SR) thus becom…

Super-Resolution

Unsupervised Learning of High-resolution Light Field Imaging via Beam Splitter-based Hybrid Lenses

2024-02-29 · Jianxin Lei, Chengcai Xu, Langqing Shi, Junhui Hou 외

In this paper, we design a beam splitter-based hybrid light field imaging prototype to record 4D light field image and high-resolution 2D image simultaneously, and make a hybrid light field dataset. The 2D image could be…

Super-Resolution