Multi-Scale Superpatch Matching using Dual Superpixel Descriptors
Over-segmentation into superpixels is a very effective dimensionality reduction strategy, enabling fast dense image processing. The main issue of this approach is the inherent irregularity of the image decomposition compared to standard hierarchical multi-resolution schemes, especially when searching for similar neighboring patterns. Several works have attempted to overcome this issue by taking into account the region irregularity into their comparison model. Nevertheless, they remain sub-optimal to provide robust and accurate superpixel neighborhood descriptors, since they only compute features within each region, poorly capturing contour information at superpixel borders. In this work, we address these limitations by introducing the dual superpatch, a novel superpixel neighborhood descriptor. This structure contains features computed in reduced superpixel regions, as well as at the interfaces of multiple superpixels to explicitly capture contour structure information. A fast multi-scale non-local matching framework is also introduced for the search of similar descriptors at different resolution levels in an image dataset. The proposed dual superpatch enables to more accurately capture similar structured patterns at different scales, and we demonstrate the robustness and performance of this new strategy on matching and supervised labeling applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionSuperpixelsSimilar Papers 제목 키워드 기반
SuperPatchMatch: an Algorithm for Robust Correspondences using Superpixel Patches
Superpixels have become very popular in many computer vision applications. Nevertheless, they remain underexploited since the superpixel decomposition may produce irregular and non stable segmentation results due to the …
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1NEMESIS: Noise-suppressed Efficient MAE with Enhanced Superpatch Integration Strategy
Volumetric CT imaging is essential for clinical diagnosis, yet annotating 3D volumes is expensive and time-consuming, motivating self-supervised learning (SSL) from unlabeled data. However, applying SSL to 3D CT remains …
Self-Supervised LearningFrom Superpixel to Human Shape Modelling for Carried Object Detection
Detecting carried objects is one of the requirements for developing systems to reason about activities involving people and objects. We present an approach to detect carried objects from a single video frame with a novel…
Objectobject-detectionObject DetectionSuperpixelsTemporal Superpixels Based on Proximity-Weighted Patch Matching
A temporal superpixel algorithm based on proximity-weighted patch matching (TS-PPM) is proposed in this work. We develop the proximity-weighted patch matching (PPM), which estimates the motion vector of a superpixel robu…
Patch MatchingSuperpixelsLearning from multiscale wavelet superpixels using GNN with spatially heterogeneous pooling
Neural networks have become the standard for image classification tasks. On one hand, convolutional neural networks (CNNs) achieve state-of-the-art performance by learning from a regular grid representation of images. On…
General ClassificationGraph Classificationimage-classificationImage Classification+1