paper-with-me

홈 › Papers

Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

2021-01-17 · Xiaofeng Liu, Fangxu Xing, Chao Yang, C. -C. Jay Kuo, Georges ElFakhri, Jonghye Woo

Deformable registration of magnetic resonance images between patients with brain tumors and healthy subjects has been an important tool to specify tumor geometry through location alignment and facilitate pathological analysis. Since tumor region does not match with any ordinary brain tissue, it has been difficult to deformably register a patients brain to a normal one. Many patient images are associated with irregularly distributed lesions, resulting in further distortion of normal tissue structures and complicating registration's similarity measure. In this work, we follow a multi-step context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. The coarse image-to-image translation is applied to make a rough inference of the missing parts. Then, a feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. A symmetry constraint reflecting a large degree of anatomical symmetry in the brain is further proposed to achieve better structure understanding. Deformable registration is applied between inpainted patient images and normal brains, and the resulting deformation field is eventually used to deform original patient data for the final alignment. The method was applied to the Multimodal Brain Tumor Segmentation (BraTS) 2018 challenge database and compared against three existing inpainting methods. The proposed method yielded results with increased peak signal-to-noise ratio, structural similarity index, inception score, and reduced L1 error, leading to successful patient-to-normal brain image registration.

📄 PDF Abstract BibTeX arXiv:2101.06775

Code (0)

등록된 구현이 없습니다.

Tasks

Brain Tumor SegmentationImage InpaintingImage RegistrationImage-to-Image TranslationTumor Segmentation

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Global and Local Attention-Based Free-Form Image Inpainting

2020-06-04 · Sensors 2020 6 · S. M. Nadim Uddin, Yong Ju Jung

Deep-learning-based image inpainting methods have shown significant promise in both rectangular and irregular holes. However, the inpainting of irregular holes presents numerous challenges owing to uncertainties in their…

FormImage Inpainting

Image Inpainting with Edge-guided Learnable Bidirectional Attention Maps

2021-04-25 · Dongsheng Wang, Chaohao Xie, Shaohui Liu, Zhenxing Niu 외

For image inpainting, the convolutional neural networks (CNN) in previous methods often adopt standard convolutional operator, which treats valid pixels and holes indistinguishably. As a result, they are limited in handl…

Image Inpaintingvalid

Image Inpainting with Learnable Bidirectional Attention Maps

2019-09-03 · ICCV 2019 10 · Chaohao Xie, Shaohui Liu, Chao Li, Ming-Ming Cheng 외

Most convolutional network (CNN)-based inpainting methods adopt standard convolution to indistinguishably treat valid pixels and holes, making them limited in handling irregular holes and more likely to generate inpainti…

DecoderImage Inpaintingvalid

Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding

2022-03-02 · CVPR 2022 1 · Qiaole Dong, Chenjie Cao, Yanwei Fu

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular t…

Image Inpainting

Advancing Brain Tumor Inpainting with Generative Models

2024-02-02 · Ruizhi Zhu, Xinru Zhang, Haowen Pang, Chundan Xu 외

Synthesizing healthy brain scans from diseased brain scans offers a potential solution to address the limitations of general-purpose algorithms, such as tissue segmentation and brain extraction algorithms, which may not …

3D Inpainting