paper-with-me

홈 › Papers

The self-supervised spectral-spatial attention-based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery

2021-11-12 · Xin Zhang, Liangxiu Han, Tam Sobeih, Lewis Lappin, Mark Lee, Andew Howard, Aron Kisdi

Nitrogen (N) fertilizer is routinely applied by farmers to increase crop yields. At present, farmers often over-apply N fertilizer in some locations or at certain times because they do not have high-resolution crop N status data. N-use efficiency can be low, with the remaining N lost to the environment, resulting in higher production costs and environmental pollution. Accurate and timely estimation of N status in crops is crucial to improving cropping systems' economic and environmental sustainability. Destructive approaches based on plant tissue analysis are time consuming and impractical over large fields. Recent advances in remote sensing and deep learning have shown promise in addressing the aforementioned challenges in a non-destructive way. In this work, we propose a novel deep learning framework: a self-supervised spectral-spatial attention-based vision transformer (SSVT). The proposed SSVT introduces a Spectral Attention Block (SAB) and a Spatial Interaction Block (SIB), which allows for simultaneous learning of both spatial and spectral features from UAV digital aerial imagery, for accurate N status prediction in wheat fields. Moreover, the proposed framework introduces local-to-global self-supervised learning to help train the model from unlabelled data. The proposed SSVT has been compared with five state-of-the-art models including: ResNet, RegNet, EfficientNet, EfficientNetV2 and the original vision transformer on both testing and independent datasets. The proposed approach achieved high accuracy (0.96) with good generalizability and reproducibility for wheat N status estimation.

📄 PDF Abstract BibTeX arXiv:2111.06839

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Sigmoid Activation 설명 없음

Similar Papers 제목 키워드 기반

Spatial-Spectral Transformer for Hyperspectral Image Denoising

2022-11-25 · Miaoyu Li, Ying Fu, Yulun Zhang

Hyperspectral image (HSI) denoising is a crucial preprocessing procedure for the subsequent HSI applications. Unfortunately, though witnessing the development of deep learning in HSI denoising area, existing convolution-…

Computational EfficiencyDenoisingHyperspectral Image DenoisingImage Denoising

Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution

2023-11-29 · Shi Chen, Lefei Zhang, Liangpei Zhang

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global s…

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

Cross-Domain Transfer with Self-Supervised Spectral-Spatial Modeling for Hyperspectral Image Classification

2026-01-26 · Jianshu Chao, Tianhua Lv, Qiqiong Ma, Yunfei Qiu 외 arxiv

Self-supervised learning has demonstrated considerable potential in hyperspectral representation, yet its application in cross-domain transfer scenarios remains under-explored. Existing methods, however, still rely on so…

Hyperspectral Image ClassificationSelf-Supervised LearningTransfer Learning

VolFormer: Explore More Comprehensive Cube Interaction for Hyperspectral Image Restoration and Beyond

2025-01-01 · CVPR 2025 1 · Dabing Yu, Zheng Gao

Capitalizing on the talent of self-attention in capturing non-local features, Transformer architectures have exhibited remarkable performance in single hyperspectral image restoration. For hyperspectral images, each …

Hyperspectral Image Super-ResolutionImage RestorationImage Super-ResolutionSuper-Resolution

FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining

2023-09-18 · Shaheer Mohamed, Maryam Haghighat, Tharindu Fernando, Sridha Sridharan 외

Hyperspectral images (HSIs) contain rich spectral and spatial information. Motivated by the success of transformers in the field of natural language processing and computer vision where they have shown the ability to lea…