paper-with-me

Papers

Mutual information neural estimation for unsupervised multi-modal registration of brain images

2022-01-25 · Gerard Snaauw, Michele Sasdelli, Gabriel Maicas, Stephan Lau, Johan Verjans, Mark Jenkinson, Gustavo Carneiro

Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance compared to iterative methods in just a fraction of the time. Most of the learning-based methods have focused on mono-modal image registration. The extension to multi-modal registration depends on the use of an appropriate similarity function, such as the mutual information (MI). We propose guiding the training of a deep learning-based registration method with MI estimation between an image-pair in an end-to-end trainable network. Our results show that a small, 2-layer network produces competitive results in both mono- and multi-modal registration, with sub-second run-times. Comparisons to both iterative and deep learning-based methods show that our MI-based method produces topologically and qualitatively superior results with an extremely low rate of non-diffeomorphic transformations. Real-time clinical application will benefit from a better visual matching of anatomical structures and less registration failures/outliers.

📄 PDF Abstract BibTeX arXiv:2201.10305

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningImage Registration

Similar Papers 제목 키워드 기반

Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization

2022-04-20 · Changjie Lu, Shen Zheng, Gaurav Gupta

Unsupervised domain adaptation approaches have recently succeeded in various medical image segmentation tasks. The reported works often tackle the domain shift problem by aligning the domain-invariant features and minimi…

Cardiac SegmentationDomain AdaptationImage SegmentationMedical Image Segmentation+4

EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 2021: Team M3EM Technical Report

2021-06-18 · Lijin Yang, Yifei HUANG, Yusuke Sugano, Yoichi Sato

In this report, we describe the technical details of our submission to the 2021 EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition. Leveraging multiple modalities has been proved to benefit…

Action RecognitionDomain AdaptationUnsupervised Domain Adaptation

DRMIME: Differentiable Mutual Information and Matrix Exponential for Multi-Resolution Image Registration

2020-01-27 · MIDL 2019 7 · Abhishek Nan, Matthew Tennant, Uriel Rubin, Nilanjan Ray

In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as …

Image RegistrationUnsupervised Image Registration

Matching Text with Deep Mutual Information Estimation

2020-03-09 · Xixi Zhou, Chengxi Li, Jiajun Bu, Chengwei Yao 외

Text matching is a core natural language processing research problem. How to retain sufficient information on both content and structure information is one important challenge. In this paper, we present a neural approach…

Answer SelectionMutual Information EstimationNatural Language InferenceParaphrase Identification+1

Multi-Modal Mutual Information Maximization: A Novel Approach for Unsupervised Deep Cross-Modal Hashing

2021-12-13 · Tuan Hoang, Thanh-Toan Do, Tam V. Nguyen, Ngai-Man Cheung

In this paper, we adopt the maximizing mutual information (MI) approach to tackle the problem of unsupervised learning of binary hash codes for efficient cross-modal retrieval. We proposed a novel method, dubbed Cross-Mo…

Cross-Modal RetrievalRetrieval