paper-with-me

홈 › Papers

FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification

2020-11-11 · Zhuo Zheng, Yanfei Zhong, Ailong Ma, Liangpei Zhang

Deep learning techniques have provided significant improvements in hyperspectral image (HSI) classification. The current deep learning based HSI classifiers follow a patch-based learning framework by dividing the image into overlapping patches. As such, these methods are local learning methods, which have a high computational cost. In this paper, a fast patch-free global learning (FPGA) framework is proposed for HSI classification. In FPGA, an encoder-decoder based FCN is utilized to consider the global spatial information by processing the whole image, which results in fast inference. However, it is difficult to directly utilize the encoder-decoder based FCN for HSI classification as it always fails to converge due to the insufficiently diverse gradients caused by the limited training samples. To solve the divergence problem and maintain the abilities of FCN of fast inference and global spatial information mining, a global stochastic stratified sampling strategy is first proposed by transforming all the training samples into a stochastic sequence of stratified samples. This strategy can obtain diverse gradients to guarantee the convergence of the FCN in the FPGA framework. For a better design of FCN architecture, FreeNet, which is a fully end-to-end network for HSI classification, is proposed to maximize the exploitation of the global spatial information and boost the performance via a spectral attention based encoder and a lightweight decoder. A lateral connection module is also designed to connect the encoder and decoder, fusing the spatial details in the encoder and the semantic features in the decoder. The experimental results obtained using three public benchmark datasets suggest that the FPGA framework is superior to the patch-based framework in both speed and accuracy for HSI classification. Code has been made available at: https://github.com/Z-Zheng/FreeNet.

📄 PDF Abstract BibTeX arXiv:2011.05670

Code (1)

Z-Zheng/FreeNet 공식 구현 pytorch

Tasks

ClassificationDecoderGeneral ClassificationHyperspectral Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

A Spectral-Spatial-Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification

2021-05-29 · Qiqi Zhu, Weihuan Deng, Zhuo Zheng, Yanfei Zhong 외

Deep learning techniques have been widely applied to hyperspectral image (HSI) classification and have achieved great success. However, the deep neural network model has a large parameter space and requires a large numbe…

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

Accelerated Feature Detectors for Visual SLAM: A Comparative Study of FPGA vs GPU

2025-10-15 · Ruiqi Ye, Mikel Luján arxiv

Feature detection is a common yet time-consuming module in Simultaneous Localization and Mapping (SLAM) implementations, which are increasingly deployed on power-constrained platforms, such as drones. Graphics Processing…

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

2019-09-17 · Xiaoyu Yu, Yuwei Wang, Jie Miao, Ephrem Wu 외

Intensive computation is entering data centers with multiple workloads of deep learning. To balance the compute efficiency, performance, and total cost of ownership (TCO), the use of a field-programmable gate array (FPGA…

GPU

Look Before You Zoom: Adaptive Routing for the Resolution-Context Trade-off in Visual RAG

2026-06-20 · Oanh N. Tran, Thanh Quoc Hung Le, Oscar Chew, Kuan-Hao Huang 외 arxiv

Vision-Language Models (VLMs) struggle as query-relevant objects become smaller. To address this, recent training-free approaches dynamically retrieve and zoom into local image regions. However, we show that indiscrimina…

FPGA-Accelerated SpeckleNN with SNL for Real-time X-ray Single-Particle Imaging

2025-02-27 · Abhilasha Dave, Cong Wang, James Russell, Ryan Herbst 외

We implement a specialized version of our SpeckleNN model for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI) using the SLAC Neural Network Library (SNL) on an FPGA. This hardware is optim…

GPU