Robust Region Grouping via Internal Patch Statistics
In this work, we present an efficient multi-scale low-rank representation for image segmentation. Our method begins with partitioning the input images into a set of superpixels, followed by seeking the optimal superpixel-pair affinity matrix, both of which are performed at multiple scales of the input images. Since low-level superpixel features are usually corrupted by image noises, we propose to infer the low-rank refined affinity matrix. The inference is guided by two observations on natural images. First, looking into a single image, local small-size image patterns tend to recur frequently within the same semantic region, but may not appear in semantically different regions. We call this internal image statistics as replication prior, and quantitatively justify it on real image databases. Second, the affinity matrices at different scales should be consistently solved, which leads to the cross-scale consistency constraint. We formulate these two purposes with one unified formulation and develop an efficient optimization procedure. Our experiments demonstrate the presented method can substantially improve segmentation accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationSemantic SegmentationSuperpixelsSimilar Papers 제목 키워드 기반
InGAN: Capturing and Remapping the "DNA" of a Natural Image
Generative Adversarial Networks (GANs) typically learn a distribution of images in a large image dataset, and are then able to generate new images from this distribution. However, each natural image has its own internal …
InGAN: Capturing and Retargeting the "DNA" of a Natural Image
Generative Adversarial Networks (GANs) typically learn a distribution of images in a large image dataset, and are then able to generate new images from this distribution. However, each natural image has its own internal …
A Generative Model of Natural Texture Surrogates
Natural images can be viewed as patchworks of different textures, where the local image statistics is roughly stationary within a small neighborhood but otherwise varies from region to region. In order to model this vari…
Image CompressionmodelLearned Shape-Tailored Descriptors for Segmentation
We address the problem of texture segmentation by grouping dense pixel-wise descriptors. We introduce and construct learned Shape-Tailored Descriptors that aggregate image statistics only within regions of interest to av…
SegmentationPatchwise Generative ConvNet: Training Energy-Based Models From a Single Natural Image for Internal Learning
Exploiting internal statistics of a single natural image has long been recognized as a significant research paradigm where the goal is to learn the distribution of patches within the image without relying on external…
DescriptiveImage GenerationSuper-Resolution