paper-with-me

Papers

Multi-granularity Backprojection Transformer for Remote Sensing Image Super-Resolution

2023-10-19 · Jinglei Hao, Wukai Li, Binglu Wang, Shunzhou Wang, Yuting Lu, Ning li, Yongqiang Zhao

Backprojection networks have achieved promising super-resolution performance for nature images but not well be explored in the remote sensing image super-resolution (RSISR) field due to the high computation costs. In this paper, we propose a Multi-granularity Backprojection Transformer termed MBT for RSISR. MBT incorporates the backprojection learning strategy into a Transformer framework. It consists of Scale-aware Backprojection-based Transformer Layers (SPTLs) for scale-aware low-resolution feature learning and Context-aware Backprojection-based Transformer Blocks (CPTBs) for hierarchical feature learning. A backprojection-based reconstruction module (PRM) is also introduced to enhance the hierarchical features for image reconstruction. MBT stands out by efficiently learning low-resolution features without excessive modules for high-resolution processing, resulting in lower computational resources. Experiment results on UCMerced and AID datasets demonstrate that MBT obtains state-of-the-art results compared to other leading methods.

📄 PDF Abstract BibTeX arXiv:2310.12507

Code (0)

등록된 구현이 없습니다.

Tasks

Image ReconstructionImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Multi-Head Attention 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Multi-Granularity Canonical Appearance Pooling for Remote Sensing Scene Classification

2020-04-09 · S. Wang, Y. Guan, L. Shao

Recognising remote sensing scene images remains challenging due to large visual-semantic discrepancies. These mainly arise due to the lack of detailed annotations that can be employed to align pixel-level representations…

ClassificationGeneral ClassificationGPUScene Classification

MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description

2024-06-07 · Cong Yang, Zuchao Li, Lefei Zhang

Recently, large multimodal models have built a bridge from visual to textual information, but they tend to underperform in remote sensing scenarios. This underperformance is due to the complex distribution of objects and…

Attribute

RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts

2024-12-07 · Xu Liu, Zhouhui Lian

Remote Sensing Vision-Language Models (RS VLMs) have made much progress in the tasks of remote sensing (RS) image comprehension. While performing well in multi-modal reasoning and multi-turn conversations, the existing m…

Change DetectionImage ComprehensionInstruction FollowingLanguage Modeling+6

Multi-Grained Angle Representation for Remote Sensing Object Detection

2022-09-07 · Hao Wang, Zhanchao Huang, Zhengchao Chen, Ying Song 외

Arbitrary-oriented object detection (AOOD) plays a significant role for image understanding in remote sensing scenarios. The existing AOOD methods face the challenges of ambiguity and high costs in angle representation. …

Objectobject-detectionObject DetectionOriented Object Detection+1

Deep SURE for Unsupervised Remote Sensing Image Fusion

2022-10-19 · IEEE Transactions on Geoscience and Remote Sensing 2022 10 · Han V. Nguyen; Magnus O. Ulfarsson; Johannes R. Sveinsson; Mauro Dalla Mura

Image fusion is utilized in remote sensing (RS) due to the limitation of the imaging sensor and the high cost of simultaneously acquiring high spatial and spectral resolution images. Optical RS imaging systems usually pr…

Hyperspectral Image Super-Resolution