TRUST -- Transformer-Driven U-Net for Sparse Target Recovery
In the context of inverse problems $\bf y = Ax$, sparse recovery offers a powerful paradigm shift by enabling the stable solution of ill-posed or underdetermined systems through the exploitation of structure, particularly sparsity. Sparse regularization techniques via $\ell_0$- or $\ell_1$-norm minimization encourage solutions $\bf x$ that are both consistent with observations $\bf y$ and parsimonious in representation, often yielding physically meaningful interpretations. In this work, we address the classical inverse problem under the challenging condition where the sensing operator $\bf A$ is unknown and only a limited set of observation-target pairs $\{ \bf x,\bf y \}$ is available. We propose a novel neural architecture, TRUST, that integrates the attention mechanism of Transformers with the decoder pathway of a UNet to simultaneously learn the sensing operator and reconstruct the sparse signal. The TRUST model incorporates a Transformer-based encoding branch to capture long-range dependencies and estimate sparse support, which then guides a U-Net-style decoder to refine reconstruction through multiscale feature integration. The skip connections between the transformer stages and the decoder not only enhance image quality but also enable the decoder to access image features at different levels of abstraction. This hybrid architecture enables more accurate and robust recovery by combining global context with local details. Experimental results demonstrate that TRUST significantly outperforms traditional sparse recovery methods and standalone U-Net models, achieving superior performance in SSIM and PSNR metrics while effectively suppressing hallucination artifacts that commonly plague deep learning-based inverse solvers.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderHallucinationSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deformable Mesh Transformer for 3D Human Mesh Recovery
We present Deformable mesh transFormer (DeFormer), a novel vertex-based approach to monocular 3D human mesh recovery. DeFormer iteratively fits a body mesh model to an input image via a mesh alignment feedback loop f…
3D Hand Pose Estimation3D Human Pose EstimationDecoderHuman Mesh RecoveryTheoretical Analysis for Extended Target Recovery in Randomized Stepped Frequency Radars
Randomized Stepped Frequency Radar (RSFR) is very attractive for tasks under complex electromagnetic environment. Due to the synthetic high range resolution in RSRFs, a target usually occupies a series of range cells and…
Jointly Sparse Signal Recovery and Support Recovery via Deep Learning with Applications in MIMO-based Grant-Free Random Access
In this paper, we investigate jointly sparse signal recovery and jointly sparse support recovery in Multiple Measurement Vector (MMV) models for complex signals, which arise in many applications in communications and sig…
Action DetectionActivity DetectionCompressive SensingPhase Transitions in Frequency Agile Radar Using Compressed Sensing
FAR has improved anti-jamming performance over traditional pulse-Doppler radars under complex electromagnetic circumstances. To reconstruct the range-Doppler information in FAR, many compressed sensing (CS) methods inclu…
compressed sensingEigenmatrix for unstructured sparse recovery
This note considers the unstructured sparse recovery problems in a general form. Examples include rational approximation, spectral function estimation, Fourier inversion, Laplace inversion, and sparse deconvolution. The …