paper-with-me

Papers

Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution

2024-11-10 · Minghong Duan, Linhao Qu, Shaolei Liu, Manning Wang

Implicit neural representations have recently demonstrated promising potential in arbitrary-scale Super-Resolution (SR) of images. Most existing methods predict the pixel in the SR image based on the queried coordinate and ensemble nearby features, overlooking the importance of incorporating high-frequency prior information in images, which results in limited performance in reconstructing high-frequency texture details in images. To address this issue, we propose the Local Implicit Wavelet Transformer (LIWT) to enhance the restoration of high-frequency texture details. Specifically, we decompose the features extracted by an encoder into four sub-bands containing different frequency information using Discrete Wavelet Transform (DWT). We then introduce the Wavelet Enhanced Residual Module (WERM) to transform these four sub-bands into high-frequency priors, followed by utilizing the Wavelet Mutual Projected Fusion (WMPF) and the Wavelet-aware Implicit Attention (WIA) to fully exploit the high-frequency prior information for recovering high-frequency details in images. We conducted extensive experiments on benchmark datasets to validate the effectiveness of LIWT. Both qualitative and quantitative results demonstrate that LIWT achieves promising performance in arbitrary-scale SR tasks, outperforming other state-of-the-art methods. The code is available at https://github.com/dmhdmhdmh/LIWT.

📄 PDF Abstract BibTeX arXiv:2411.06442

Code (1)

dmhdmhdmh/liwt 공식 구현 pytorch

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution

2023-03-29 · CVPR 2023 1 · Hao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai 외

Implicit neural representation has recently shown a promising ability in representing images with arbitrary resolutions. In this paper, we present a Local Implicit Transformer (LIT), which integrates the attention mechan…

Super-Resolution

Adaptive Wavelet Transformer Network for 3D Shape Representation Learning

2021-09-29 · ICLR 2022 4 · Hao Huang, Yi Fang

We present a novel method for 3D shape representation learning using multi-scale wavelet decomposition. Distinct from previous works that either decompose 3D shapes into complimentary components at a single scale, or nai…

3D Shape Classification3D Shape RepresentationRepresentation Learning

TFWaveFormer: Temporal-Frequency Collaborative Multi-level Wavelet Transformer for Dynamic Link Prediction

2026-03-04 · Hantong Feng, Yonggang Wu, Duxin Chen, Wenwu Yu arxiv

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promi…

Dynamic Link PredictionGraph Learning

PT-WNO: Point Transformer with Wavelet Neural Operator for 3D Point Cloud Semantic Segmentation

2026-06-09 · Nhut Le, Maryam Rahnemoonfar arxiv

Point cloud semantic segmentation requires architectures that capture both fine-grained local geometry and broad global scene structure. Transformer-based networks have demonstrated strong performance by focusing on deta…

Semantic SegmentationScene Understanding

Multi-Scale Implicit Transformer with Re-parameterize for Arbitrary-Scale Super-Resolution

2024-03-11 · Jinchen Zhu, Mingjian Zhang, Ling Zheng, Shizhuang Weng

Recently, the methods based on implicit neural representations have shown excellent capabilities for arbitrary-scale super-resolution (ASSR). Although these methods represent the features of an image by generating latent…

DiversitySuper-Resolution