A Spectral Nonlocal Block for Neural Networks
The nonlocal-based blocks are designed for capturing long-range spatial-temporal dependencies in computer vision tasks. Although having shown excellent performances, they lack the mechanism to encode the rich, structured information among elements in an image. In this paper, to theoretically analyze the property of these nonlocal-based blocks, we provide a unified approach to interpreting them, where we view them as a graph filter generated on a fully-connected graph. When the graph filter is approximated by Chebyshev polynomials, a generalized formulation can be derived for explaining the existing nonlocal-based blocks ($\mathit{e.g.,}$ nonlocal block, nonlocal stage, double attention block). Furthermore, we propose an efficient and robust spectral nonlocal block, which can be flexibly inserted into deep neural networks to catch the long-range dependencies between spatial pixels or temporal frames. Experimental results demonstrate the clear-cut improvements and practical applicabilities of the spectral nonlocal block on image classification (Cifar-10/100, ImageNet), fine-grained image classification (CUB-200), action recognition (UCF-101), and person re-identification (ILID-SVID, Mars, Prid-2011) tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionFine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationPerson Re-IdentificationVideo ClassificationSimilar Papers 제목 키워드 기반
A Unified Framework to Analyze and Design the Nonlocal Blocks for Neural Networks
The nonlocal-based blocks are designed for capturing long-range spatial-temporal dependencies in computer vision tasks. Although having shown excellent performances, they lack the mechanism to encode the rich, structured…
Action RecognitionFine-Grained Image Classificationimage-classificationImage ClassificationUnifying Nonlocal Blocks for Neural Networks
The nonlocal-based blocks are designed for capturing long-range spatial-temporal dependencies in computer vision tasks. Although having shown excellent performance, they still lack the mechanism to encode the rich, struc…
Action Recognitionimage-classificationImage ClassificationPerson Re-Identification+1Spectral Nonlocal Block for Neural Network
The nonlocal network is designed for capturing long-range spatial-temporal dependencies in several computer vision tasks. Although having shown excellent performances, it needs an elaborate preparation for both the numbe…
Video ClassificationDecomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising
As compared to the conventional RGB or gray-scale images, multispectral images (MSI) can deliver more faithful representation for real scenes, and enhance the performance of many computer vision tasks. In practice, howev…
DenoisingDictionary LearningImage DenoisingGraph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
Most domain adaptation (DA) methods in cross-scene hyperspectral image classification focus on cases where source data (SD) and target data (TD) with the same classes are obtained by the same sensor. However, the classif…
Cross-Domain Few-Shotcross-domain few-shot learningDomain AdaptationFew-Shot Image Classification+4