paper-with-me

Papers

TRUST -- Transformer-Driven U-Net for Sparse Target Recovery

2025-06-01 · Di An, Dylan Poppert, Jiayue Li, Mark Foster, Trac D. Tran

In the context of inverse problems $\bf y = Ax$, sparse recovery offers a powerful paradigm shift by enabling the stable solution of ill-posed or underdetermined systems through the exploitation of structure, particularly sparsity. Sparse regularization techniques via $\ell_0$- or $\ell_1$-norm minimization encourage solutions $\bf x$ that are both consistent with observations $\bf y$ and parsimonious in representation, often yielding physically meaningful interpretations. In this work, we address the classical inverse problem under the challenging condition where the sensing operator $\bf A$ is unknown and only a limited set of observation-target pairs $\{ \bf x,\bf y \}$ is available. We propose a novel neural architecture, TRUST, that integrates the attention mechanism of Transformers with the decoder pathway of a UNet to simultaneously learn the sensing operator and reconstruct the sparse signal. The TRUST model incorporates a Transformer-based encoding branch to capture long-range dependencies and estimate sparse support, which then guides a U-Net-style decoder to refine reconstruction through multiscale feature integration. The skip connections between the transformer stages and the decoder not only enhance image quality but also enable the decoder to access image features at different levels of abstraction. This hybrid architecture enables more accurate and robust recovery by combining global context with local details. Experimental results demonstrate that TRUST significantly outperforms traditional sparse recovery methods and standalone U-Net models, achieving superior performance in SSIM and PSNR metrics while effectively suppressing hallucination artifacts that commonly plague deep learning-based inverse solvers.

📄 PDF Abstract BibTeX arXiv:2506.01112

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderHallucinationSSIM

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
U-Net 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Deformable Mesh Transformer for 3D Human Mesh Recovery

2023-01-01 · CVPR 2023 1 · Yusuke Yoshiyasu

We present Deformable mesh transFormer (DeFormer), a novel vertex-based approach to monocular 3D human mesh recovery. DeFormer iteratively fits a body mesh model to an input image via a mesh alignment feedback loop f…

3D Hand Pose Estimation3D Human Pose EstimationDecoderHuman Mesh Recovery

Theoretical Analysis for Extended Target Recovery in Randomized Stepped Frequency Radars

2019-08-08 · Lei Wang, Tianyao Huang, Yimin Liu

Randomized Stepped Frequency Radar (RSFR) is very attractive for tasks under complex electromagnetic environment. Due to the synthetic high range resolution in RSRFs, a target usually occupies a series of range cells and…

Jointly Sparse Signal Recovery and Support Recovery via Deep Learning with Applications in MIMO-based Grant-Free Random Access

2020-08-05 · Ying Cui, Shuaichao Li, Wanqing Zhang

In this paper, we investigate jointly sparse signal recovery and jointly sparse support recovery in Multiple Measurement Vector (MMV) models for complex signals, which arise in many applications in communications and sig…

Action DetectionActivity DetectionCompressive Sensing

Phase Transitions in Frequency Agile Radar Using Compressed Sensing

2020-12-30 · Yuhan Li, Tianyao Huang, Xingyu Xu, Yimin Liu 외

FAR has improved anti-jamming performance over traditional pulse-Doppler radars under complex electromagnetic circumstances. To reconstruct the range-Doppler information in FAR, many compressed sensing (CS) methods inclu…

compressed sensing

Eigenmatrix for unstructured sparse recovery

2023-11-28 · Lexing Ying

This note considers the unstructured sparse recovery problems in a general form. Examples include rational approximation, spectral function estimation, Fourier inversion, Laplace inversion, and sparse deconvolution. The …