paper-with-me

홈 › Papers

psPRF:Pansharpening Planar Neural Radiance Field for Generalized 3D Reconstruction Satellite Imagery

2024-06-22 · Tongtong Zhang, Yuanxiang Li

Most current NeRF variants for satellites are designed for one specific scene and fall short of generalization to new geometry. Additionally, the RGB images require pan-sharpening as an independent preprocessing step. This paper introduces psPRF, a Planar Neural Radiance Field designed for paired low-resolution RGB (LR-RGB) and high-resolution panchromatic (HR-PAN) images from satellite sensors with Rational Polynomial Cameras (RPC). To capture the cross-modal prior from both of the LR-RGB and HR-PAN images, for the Unet-shaped architecture, we adapt the encoder with explicit spectral-to-spatial convolution (SSConv) to enhance the multimodal representation ability. To support the generalization ability of psRPF across scenes, we adopt projection loss to ensure strong geometry self-supervision. The proposed method is evaluated with the multi-scene WorldView-3 LR-RGB and HR-PAN pairs, and achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2406.15707

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionNeRF

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis

2022-04-28 · CVPR 2022 1 · Zhi-Hao Lin, Wei-Chiu Ma, Hao-Yu Hsu, Yu-Chiang Frank Wang 외

We present Neural Mixtures of Planar Experts (NeurMiPs), a novel planar-based scene representation for modeling geometry and appearance. NeurMiPs leverages a collection of local planar experts in 3D space as the scene re…

Novel View Synthesis

Deep Convolutional Sparse Coding Network for Pansharpening with Guidance of Side Information

2021-03-10 · Shuang Xu, Jiangshe Zhang, Kai Sun, Zixiang Zhao 외

Pansharpening is a fundamental issue in remote sensing field. This paper proposes a side information partially guided convolutional sparse coding (SCSC) model for pansharpening. The key idea is to split the low resolutio…

PansharpeningRolling Shutter Correction

Fourier Splatting: Generalized Fourier encoded primitives for scalable radiance fields

2026-03-20 · Mihnea-Bogdan Jurca, Bert Van hauwermeiren, Adrian Munteanu arxiv

Novel view synthesis has recently been revolutionized by 3D Gaussian Splatting (3DGS), which enables real-time rendering through explicit primitive rasterization. However, existing methods tie visual fidelity strictly to…

Novel View Synthesis

Planar Reflection-Aware Neural Radiance Fields

2024-11-07 · Chen Gao, Yipeng Wang, Changil Kim, Jia-Bin Huang 외

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when…

NeRF

Model-based image adjustment for a successful pansharpening

2021-03-04 · Gintautas Palubinskas

A new model-based image adjustment for the enhancement of multi-resolution image fusion or pansharpening is proposed. Such image adjustment is needed for most pansharpening methods using panchromatic band and/or intensit…

modelPansharpening