paper-with-me

Papers

Attention-Guided Low-Rank Tensor Completion

2024-07-17 · IEEE Transactions on Pattern Analysis and Machine Intelligence 2024 7 · Truong Thanh Nhat Mai, Edmund Y. Lam, Chul Lee

Low-rank tensor completion (LRTC) aims to recover missing data of high-dimensional structures from a limited set of observed entries. Despite recent significant successes, the original structures of data tensors are still not effectively preserved in LRTC algorithms, yielding less accurate restoration results. Moreover, LRTC algorithms often incur high computational costs, which hinder their applicability. In this work, we propose an attention-guided low-rank tensor completion (AGTC) algorithm, which can faithfully restore the original structures of data tensors using deep unfolding attention-guided tensor factorization. First, we formulate the LRTC task as a robust factorization problem based on low-rank and sparse error assumptions. Low-rank tensor recovery is guided by an attention mechanism to better preserve the structures of the original data. We also develop implicit regularizers to compensate for modeling inaccuracies. Then, we solve the optimization problem by employing an iterative technique. Finally, we design a multistage deep network by unfolding the iterative algorithm, where each stage corresponds to an iteration of the algorithm; at each stage, the optimization variables and regularizers are updated by closed-form solutions and learned deep networks, respectively. Experimental results for high dynamic range imaging and hyperspectral image restoration show that the proposed algorithm outperforms state-of-the-art algorithms.

📄 PDF Abstract BibTeX

Code (1)

mtntruong/AGTC 공식 구현 pytorch

Tasks

Image Restoration

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Smooth PARAFAC Decomposition for Tensor Completion

2015-05-25 · Tatsuya Yokota, Qibin Zhao, Andrzej Cichocki

In recent years, low-rank based tensor completion, which is a higher-order extension of matrix completion, has received considerable attention. However, the low-rank assumption is not sufficient for the recovery of visua…

Matrix Completion

Tensor train rank minimization with nonlocal self-similarity for tensor completion

2020-04-29 · Meng Ding, Ting-Zhu Huang, Xi-Le Zhao, Michael K. Ng 외

The tensor train (TT) rank has received increasing attention in tensor completion due to its ability to capture the global correlation of high-order tensors ($\textrm{order} >3$). For third order visual data, direct TT r…

Low-Rank Tensor Completion by Truncated Nuclear Norm Regularization

2017-12-03 · Shengke Xue, Wenyuan Qiu, Fan Liu, Xinyu Jin

Currently, low-rank tensor completion has gained cumulative attention in recovering incomplete visual data whose partial elements are missing. By taking a color image or video as a three-dimensional (3D) tensor, previous…

Cross: Efficient Low-rank Tensor Completion

2016-11-03 · Anru Zhang

The completion of tensors, or high-order arrays, attracts significant attention in recent research. Current literature on tensor completion primarily focuses on recovery from a set of uniformly randomly measured entries,…

Beyond Low Rank: A Data-Adaptive Tensor Completion Method

2017-08-03 · Lei Zhang, Wei Wei, Qinfeng Shi, Chunhua Shen 외

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) h…