paper-with-me

Papers

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

2024-02-29 · CVPR 2024 1 · Tony C. W. Mok, Zi Li, Yunhao Bai, Jianpeng Zhang, Wei Liu, Yan-Jie Zhou, Ke Yan, Dakai Jin, Yu Shi, Xiaoli Yin, Le Lu, Ling Zhang

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image registration algorithms rely on statistical-based similarity measures or local structural image representations. However, the former is sensitive to locally varying noise, while the latter is not discriminative enough to cope with complex anatomical structures in multimodal scans, causing ambiguity in determining the anatomical correspondence across scans with different modalities. In this paper, we propose a modality-agnostic structural representation learning method, which leverages Deep Neighbourhood Self-similarity (DNS) and anatomy-aware contrastive learning to learn discriminative and contrast-invariance deep structural image representations (DSIR) without the need for anatomical delineations or pre-aligned training images. We evaluate our method on multiphase CT, abdomen MR-CT, and brain MR T1w-T2w registration. Comprehensive results demonstrate that our method is superior to the conventional local structural representation and statistical-based similarity measures in terms of discriminability and accuracy.

📄 PDF Abstract BibTeX arXiv:2402.18933

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyContrastive LearningImage RegistrationMedical Image AnalysisMedical Image RegistrationRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Learning to Unify Deformable Shape and Texture Representations for Cardiac Video Classification

2026-07-08 · Tonmoy Hossain, Miaomiao Zhang arxiv

Deformable shape representations have proven to be robust complements to texture features in cardiac image classification, offering geometric priors that are invariant to imaging artifacts and intensity variations. Howev…

Image ClassificationVideo Classification

ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration

2022-06-27 · Neel Dey, Jo Schlemper, Seyed Sadegh Mohseni Salehi, Bo Zhou 외

Establishing voxelwise semantic correspondence across distinct imaging modalities is a foundational yet formidable computer vision task. Current multi-modality registration techniques maximize hand-crafted inter-domain s…

Contrastive LearningImage RegistrationRepresentation LearningSemantic correspondence

Deformable Kernel Networks for Joint Image Filtering

2019-10-17 · Beomjun Kim, Jean Ponce, Bumsub Ham

Joint image filters are used to transfer structural details from a guidance picture used as a prior to a target image, in tasks such as enhancing spatial resolution and suppressing noise. Previous methods based on convol…

Depth Map Super-ResolutionImage RestorationSemantic Segmentation

Modality-Agnostic fMRI Decoding of Vision and Language

2024-03-18 · Mitja Nikolaus, Milad Mozafari, Nicholas Asher, Leila Reddy 외

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language model…

Decoder

Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain

2026-06-03 · Alessandro Gambetti, Qiwei Han, Cláudia Soares, Hong Shen arxiv

Vision-Language Models (VLMs) struggle when applied to medical image-text data, yet the tools available to diagnose this failure remain limited. Existing representation alignment metrics are symmetric, collapsing both mo…