Learning the 2-D Topology of Images
We study the following question: is the two-dimensional structure of images a very strong prior or is it something that can be learned with a few examples of natural images? If someone gave us a learning task involving images for which the two-dimensional topology of pixels was not known, could we discover it automatically and exploit it? For example suppose that the pixels had been permuted in a fixed but unknown way, could we recover the relative two-dimensional location of pixels on images? The surprising result presented here is that not only the answer is yes but that about as few as a thousand images are enough to approximately recover the relative locations of about a thousand pixels. This is achieved using a manifold learning algorithm applied to pixels associated with a measure of distributional similarity between pixel intensities. We compare different topology-extraction approaches and show how having the two-dimensional topology can be exploited.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Topology-Attention ConvLSTM Network and Its Application to EM Images
Structural accuracy of segmentation is important for finescale structures in biomedical images. We propose a novel TopologyAttention ConvLSTM Network (TACNet) for 3D image segmentation in order to achieve high structural…
Image SegmentationSegmentationSemantic SegmentationFeaturing the topology with the unsupervised machine learning
Images of line drawings are generally composed of primitive elements. One of the most fundamental elements to characterize images is the topology; line segments belong to a category different from closed circles, and clo…
BIG-bench Machine LearningClusteringImage ClusteringTopoGAN: A Topology-Aware Generative Adversarial Network
Existing generative adversarial networks (GANs) focus on generating realistic images based on CNN-derived image features, but fail to preserve the structural properties of real images. This can be fatal in applications w…
Generative Adversarial NetworkSegmentation of Three-dimensional Images with Parametric Active Surfaces and Topology Changes
In this paper, we introduce a novel parametric method for segmentation of three-dimensional images. We consider a piecewise constant version of the Mumford-Shah and the Chan-Vese functionals and perform a region-based se…
SegmentationSemi-supervised Segmentation of Histopathology Images with Noise-Aware Topological Consistency
In digital pathology, segmenting densely distributed objects like glands and nuclei is crucial for downstream analysis. Since detailed pixel-wise annotations are very time-consuming, we need semi-supervised segmentation …