Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography

2025-03-31 · Lin Zhao, Xin Yu, Yikang Liu, Xiao Chen, Eric Z. Chen, Terrence Chen, Shanhui Sun

Accurate correspondence matching in coronary angiography images is crucial for reconstructing 3D coronary artery structures, which is essential for precise diagnosis and treatment planning of coronary artery disease (CAD). Traditional matching methods for natural images often fail to generalize to X-ray images due to inherent differences such as lack of texture, lower contrast, and overlapping structures, compounded by insufficient training data. To address these challenges, we propose a novel pipeline that generates realistic paired coronary angiography images using a diffusion model conditioned on 2D projections of 3D reconstructed meshes from Coronary Computed Tomography Angiography (CCTA), providing high-quality synthetic data for training. Additionally, we employ large-scale image foundation models to guide feature aggregation, enhancing correspondence matching accuracy by focusing on semantically relevant regions and keypoints. Our approach demonstrates superior matching performance on synthetic datasets and effectively generalizes to real-world datasets, offering a practical solution for this task. Furthermore, our work investigates the efficacy of different foundation models in correspondence matching, providing novel insights into leveraging advanced image foundation models for medical imaging applications.

📄 PDF Abstract BibTeX arXiv:2504.00191

Code (0)

등록된 구현이 없습니다.

Tasks

model

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

RARE: Refine Any Registration of Pairwise Point Clouds via Zero-Shot Learning

2025-07-26 · Chengyu Zheng, Jin Huang, Honghua Chen, Mingqiang Wei arxiv

Recent research leveraging large-scale pretrained diffusion models has demonstrated the potential of using diffusion features to establish semantic correspondences in images. Inspired by advancements in diffusion-based t…

Point Cloud Registration Zero-Shot Learning Point Clouds

Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence

2026-05-28 · Artur Jesslen, Olaf Dünkel, Adam Kortylewski arxiv

Foundation features from self-supervised vision models and text-to-image diffusion models have proven effective for semantic correspondence estimation. However, because these features are learned primarily from 2D image …

Semantic correspondence

GeoBiked: A Dataset with Geometric Features and Automated Labeling Techniques to Enable Deep Generative Models in Engineering Design

2024-09-25 · Phillip Mueller, Sebastian Mueller, Lars Mikelsons

We provide a dataset for enabling Deep Generative Models (DGMs) in engineering design and propose methods to automate data labeling by utilizing large-scale foundation models. GeoBiked is curated to contain 4 355 bicycle…

Image Generation Prompt Engineering

Diff$^2$I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior

2025-07-09 · Juncheng Mu, Chengwei Ren, Weixiang Zhang, Liang Pan 외 arxiv

Learning cross-modal correspondences is essential for image-to-point cloud (I2P) registration. Existing methods achieve this mostly by utilizing metric learning to enforce feature alignment across modalities, disregardin…

Point Cloud Registration Metric Learning

Gromov Wasserstein Optimal Transport for Semantic Correspondences

2026-02-03 · Francis Snelgar, Stephen Gould, Ming Xu, Liang Zheng 외 arxiv

Establishing correspondences between image pairs is a long studied problem in computer vision. With recent large-scale foundation models showing strong zero-shot performance on downstream tasks including classification a…