Adversarial Image Alignment and Interpolation
Volumetric (3d) images are acquired for many scientific and biomedical purposes using imaging methods such as serial section microscopy, CT scans, and MRI. A frequent step in the analysis and reconstruction of such data is the alignment and registration of images that were acquired in succession along a spatial or temporal dimension. For example, in serial section electron microscopy, individual 2d sections are imaged via electron microscopy and then must be aligned to one another in order to produce a coherent 3d volume. State of the art approaches find image correspondences derived from patch matching and invariant feature detectors, and then solve optimization problems that rigidly or elastically deform series of images into an aligned volume. Here we show how fully convolutional neural networks trained with an adversarial loss function can be used for two tasks: (1) synthesis of missing or damaged image data from adjacent sections, and (2) fine-scale alignment of block-face electron microscopy data. Finally, we show how these two capabilities can be combined in order to produce artificial isotropic volumes from anisotropic image volumes using a super-resolution adversarial alignment and interpolation approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Patch MatchingSuper-ResolutionSimilar Papers 제목 키워드 기반
Generative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourage convex latent distributions
We present a neural network architecture based upon the Autoencoder (AE) and Generative Adversarial Network (GAN) that promotes a convex latent distribution by training adversarially on latent space interpolations. By us…
Generative Adversarial NetworkRobust Alignment: Harmonizing Clean Accuracy and Adversarial Robustness in Adversarial Training
Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we …
Adversarial Robustness3D Registration of pre-surgical prostate MRI and histopathology images via super-resolution volume reconstruction
The use of MRI for prostate cancer diagnosis and treatment is increasing rapidly. However, identifying the presence and extent of cancer on MRI remains challenging, leading to high variability in detection even among exp…
Generative Adversarial NetworkImage Super-ResolutionSuper-ResolutionGenerative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourages convex latent distributions
We present a neural network architecture based upon the Autoencoder (AE) and Generative Adversarial Network (GAN) that promotes a convex latent distribution by training adversarially on latent space interpolations. By us…
Generative Adversarial NetworkHarmonizing Transferability and Discriminability for Adapting Object Detectors
Recent advances in adaptive object detection have achieved compelling results in virtue of adversarial feature adaptation to mitigate the distributional shifts along the detection pipeline. Whilst adversarial adaptation …
Objectobject-detectionObject DetectionWeakly Supervised Object Detection