paper-with-me

홈 › Papers

Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution

2023-03-29 · CVPR 2023 1 · Hao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai, Hsien-Kai Kuo, Chun-Yi Lee

Implicit neural representation has recently shown a promising ability in representing images with arbitrary resolutions. In this paper, we present a Local Implicit Transformer (LIT), which integrates the attention mechanism and frequency encoding technique into a local implicit image function. We design a cross-scale local attention block to effectively aggregate local features. To further improve representative power, we propose a Cascaded LIT (CLIT) that exploits multi-scale features, along with a cumulative training strategy that gradually increases the upsampling scales during training. We have conducted extensive experiments to validate the effectiveness of these components and analyze various training strategies. The qualitative and quantitative results demonstrate that LIT and CLIT achieve favorable results and outperform the prior works in arbitrary super-resolution tasks.

📄 PDF Abstract BibTeX arXiv:2303.16513

Code (1)

jaroslaw1007/clit 공식 구현 pytorch

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution

2024-11-10 · Minghong Duan, Linhao Qu, Shaolei Liu, Manning Wang

Implicit neural representations have recently demonstrated promising potential in arbitrary-scale Super-Resolution (SR) of images. Most existing methods predict the pixel in the SR image based on the queried coordinate a…

Super-Resolution

Multi-scale Hierarchical Vision Transformer with Cascaded Attention Decoding for Medical Image Segmentation

2023-03-29 · Md Mostafijur Rahman, Radu Marculescu

Transformers have shown great success in medical image segmentation. However, transformers may exhibit a limited generalization ability due to the underlying single-scale self-attention (SA) mechanism. In this paper, we …

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

Multi-Scale FCN With Cascaded Instance Aware Segmentation for Arbitrary Oriented Word Spotting in the Wild

2017-07-01 · CVPR 2017 7 · Dafang He, Xiao Yang, Chen Liang, Zihan Zhou 외

Scene text detection has attracted great attention these years. Text potentially exist in a wide variety of images or videos and play an important role in understanding the scene. In this paper, we present a novel t…

Scene Text DetectionText Detection

Multi-Scale Implicit Transformer with Re-parameterize for Arbitrary-Scale Super-Resolution

2024-03-11 · Jinchen Zhu, Mingjian Zhang, Ling Zheng, Shizhuang Weng

Recently, the methods based on implicit neural representations have shown excellent capabilities for arbitrary-scale super-resolution (ASSR). Although these methods represent the features of an image by generating latent…

DiversitySuper-Resolution

Oriented Object Detection with Transformer

2021-06-06 · Teli Ma, Mingyuan Mao, Honghui Zheng, Peng Gao 외

Object detection with Transformers (DETR) has achieved a competitive performance over traditional detectors, such as Faster R-CNN. However, the potential of DETR remains largely unexplored for the more challenging task o…

Objectobject-detectionObject DetectionOriented Object Detection