Exploring Deep Registration Latent Spaces
Explainability of deep neural networks is one of the most challenging and interesting problems in the field. In this study, we investigate the topic focusing on the interpretability of deep learning-based registration methods. In particular, with the appropriate model architecture and using a simple linear projection, we decompose the encoding space, generating a new basis, and we empirically show that this basis captures various decomposed anatomically aware geometrical transformations. We perform experiments using two different datasets focusing on lungs and hippocampus MRI. We show that such an approach can decompose the highly convoluted latent spaces of registration pipelines in an orthogonal space with several interesting properties. We hope that this work could shed some light on a better understanding of deep learning-based registration methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningHippocampusMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representations
We propose a fully unsupervised multi-modal deformable image registration method (UMDIR), which does not require any ground truth deformation fields or any aligned multi-modal image pairs during training. Multi-modal reg…
Image RegistrationImage-to-Image TranslationMedical Image AnalysisTLRN: Temporal Latent Residual Networks For Large Deformation Image Registration
This paper presents a novel approach, termed {\em Temporal Latent Residual Network (TLRN)}, to predict a sequence of deformation fields in time-series image registration. The challenge of registering time-series images o…
Image RegistrationTime SeriesAll Roads Lead to Rome? Exploring Representational Similarities Between Latent Spaces of Generative Image Models
Do different generative image models secretly learn similar underlying representations? We investigate this by measuring the latent space similarity of four different models: VAEs, GANs, Normalizing Flows (NFs), and Diff…
AllAttributeGMapLatent: Geometric Mapping in Latent Space
Cross-domain generative models based on encoder-decoder AI architectures have attracted much attention in generating realistic images, where domain alignment is crucial for generation accuracy. Domain alignment methods u…
DecoderExploring Semantic Variations in GAN Latent Spaces via Matrix Factorization
Controlled data generation with GANs is desirable but challenging due to the nonlinearity and high dimensionality of their latent spaces. In this work, we explore image manipulations learned by GANSpace, a state-of-the-a…
Disentanglement