paper-with-me

Papers

PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction

2026-06-09 · Yuzhe Gui, Tianzhu Liu, Yanfeng Gu, Xian Li arxiv

Snapshot Broadband Filter Array (BFA) imaging provides high light throughput for spectral reconstruction but introduces severe spectral aliasing due to complex modulation. Current deep learning approaches, limited to spatial denoising, often fail to address the global frequency-specific degradations caused by the mask structure. To address this, we propose a Physics-embedded Frequency-aware Transformer (PF-Trans) for high-fidelity remote sensing spectral reconstruction. Our method explicitly integrates the physical sensing model through mask injection and a gray-scale consistency loss to ensure physical fidelity. Furthermore, we introduce a Dual-domain Block with a parallel Fast Fourier Transform (FFT) branch, enabling the network to perceive and suppress aliasing artifacts in the frequency domain. Extensive experiments on multiple datasets demonstrate that PF-Trans achieves state-of-the-art performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of up to 48.50 dB on the GF-5 Shanghai dataset, significantly outperforming comparison methods.

📄 PDF Abstract BibTeX arXiv:2606.10373

Code (0)

등록된 구현이 없습니다.

Tasks

Spectral Reconstruction

Similar Papers 제목 키워드 기반

Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting

2025-06-08 · Tengfei Lyu, Weijia Zhang, Hao liu

Subseasonal-to-seasonal (S2S) forecasting, which predicts climate conditions from several weeks to months in advance, presents significant challenges due to the chaotic dynamics of atmospheric systems and complex interac…

Transport-Embedded Neural Architecture: Redefining the Landscape of physics aware neural models in fluid mechanics

2024-10-05 · Amirmahdi Jafari

This work introduces a new neural model which follows the transport equation by design. A physical problem, the Taylor-Green vortex, defined on a bi-periodic domain, is used as a benchmark to evaluate the performance of …

Array Camera Image Fusion using Physics-Aware Transformers

2022-07-05 · Qian Huang, Minghao Hu, David Jones Brady

We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for syntheti…

Image Generation

Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformer

2024-07-17 · Wenhan Wu, Ce Zheng, Zihao Yang, Chen Chen 외

Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing tran…

Action RecognitionSkeleton Based Action Recognition

Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models

2026-05-01 · Chenyu Zhang, Xinchen Lyu, Chenshan Ren, Shuhan Liu 외 arxiv

Positional encoding plays a pivotal role in determin?ing the extrapolation and generalization performance of wireless foundation models for channel state information (CSI) modeling, latent characterization, and task-spec…

Zero-shot Generalization