paper-with-me

홈 › Papers

SynStitch: a Self-Supervised Learning Network for Ultrasound Image Stitching Using Synthetic Training Pairs and Indirect Supervision

2024-11-11 · Xing Yao, Runxuan Yu, Dewei Hu, Hao Yang, Ange Lou, Jiacheng Wang, Daiwei Lu, Gabriel Arenas, Baris Oguz, Alison Pouch, Nadav Schwartz, Brett C Byram, Ipek Oguz

Ultrasound (US) image stitching can expand the field-of-view (FOV) by combining multiple US images from varied probe positions. However, registering US images with only partially overlapping anatomical contents is a challenging task. In this work, we introduce SynStitch, a self-supervised framework designed for 2DUS stitching. SynStitch consists of a synthetic stitching pair generation module (SSPGM) and an image stitching module (ISM). SSPGM utilizes a patch-conditioned ControlNet to generate realistic 2DUS stitching pairs with known affine matrix from a single input image. ISM then utilizes this synthetic paired data to learn 2DUS stitching in a supervised manner. Our framework was evaluated against multiple leading methods on a kidney ultrasound dataset, demonstrating superior 2DUS stitching performance through both qualitative and quantitative analyses. The code will be made public upon acceptance of the paper.

📄 PDF Abstract BibTeX arXiv:2411.06750

Code (0)

등록된 구현이 없습니다.

Tasks

Image StitchingSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Exploring the Utility of Self-Supervised Pretraining Strategies for the Detection of Absent Lung Sliding in M-Mode Lung Ultrasound

2023-04-05 · Blake VanBerlo, Brian Li, Alexander Wong, Jesse Hoey 외

Self-supervised pretraining has been observed to improve performance in supervised learning tasks in medical imaging. This study investigates the utility of self-supervised pretraining prior to conducting supervised fine…

Data Augmentation

Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images

2021-06-24 · Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu 외

Traditional feature-based image stitching technologies rely heavily on feature detection quality, often failing to stitch images with few features or low resolution. The learning-based image stitching solutions are rarel…

Image ReconstructionImage Stitching

Self-Supervised Learning with Limited Labeled Data for Prostate Cancer Detection in High Frequency Ultrasound

2022-11-01 · Paul F. R. Wilson, Mahdi Gilany, Amoon Jamzad, Fahimeh Fooladgar 외

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised lear…

Representation LearningSelf-Supervised Learning

Weakly-Supervised Stitching Network for Real-World Panoramic Image Generation

2022-09-13 · Dae-Young Song, Geonsoo Lee, HeeKyung Lee, Gi-Mun Um 외

Recently, there has been growing attention on an end-to-end deep learning-based stitching model. However, the most challenging point in deep learning-based stitching is to obtain pairs of input images with a narrow field…

Deep LearningImage GenerationSSIMWeakly-supervised Learning

Perception Consistency Ultrasound Image Super-resolution via Self-supervised CycleGAN

2020-12-28 · Heng Liu, Jianyong Liu, Tao Tao, Shudong Hou 외

Due to the limitations of sensors, the transmission medium and the intrinsic properties of ultrasound, the quality of ultrasound imaging is always not ideal, especially its low spatial resolution. To remedy this situatio…

Generative Adversarial NetworkImage EnhancementImage Super-ResolutionSSIM+1