paper-with-me

Papers

Shape-consistent Generative Adversarial Networks for multi-modal Medical segmentation maps

2022-01-24 · Leo Segre, Or Hirschorn, Dvir Ginzburg, Dan Raviv

Image translation across domains for unpaired datasets has gained interest and great improvement lately. In medical imaging, there are multiple imaging modalities, with very different characteristics. Our goal is to use cross-modality adaptation between CT and MRI whole cardiac scans for semantic segmentation. We present a segmentation network using synthesised cardiac volumes for extremely limited datasets. Our solution is based on a 3D cross-modality generative adversarial network to share information between modalities and generate synthesized data using unpaired datasets. Our network utilizes semantic segmentation to improve generator shape consistency, thus creating more realistic synthesised volumes to be used when re-training the segmentation network. We show that improved segmentation can be achieved on small datasets when using spatial augmentations to improve a generative adversarial network. These augmentations improve the generator capabilities, thus enhancing the performance of the Segmentor. Using only 16 CT and 16 MRI cardiovascular volumes, improved results are shown over other segmentation methods while using the suggested architecture.

📄 PDF Abstract BibTeX arXiv:2201.09693

Code (2)

orhir/3d-shape-consistent-gan 공식 구현 pytorch
orhir/shape-consistent-generative-adversarial-networks-for-multi-modal-medical-segmentation-maps 공식 구현 pytorch

Tasks

Generative Adversarial NetworkSegmentationSemantic SegmentationTranslation

Similar Papers 제목 키워드 기반

Multimodal Shape Completion via Conditional Generative Adversarial Networks

2020-03-17 · ECCV 2020 8 · Rundi Wu, Xuelin Chen, Yixin Zhuang, Baoquan Chen

Several deep learning methods have been proposed for completing partial data from shape acquisition setups, i.e., filling the regions that were missing in the shape. These methods, however, only complete the partial shap…

Diversity

Shape Generation using Spatially Partitioned Point Clouds

2017-07-19 · Matheus Gadelha, Subhransu Maji, Rui Wang

We propose a method to generate 3D shapes using point clouds. Given a point-cloud representation of a 3D shape, our method builds a kd-tree to spatially partition the points. This orders them consistently across all shap…

On the application of generative adversarial networks for nonlinear modal analysis

2022-03-02 · G. Tsialiamanis, M. D. Champneys, N. Dervilis, D. J. Wagg 외

Linear modal analysis is a useful and effective tool for the design and analysis of structures. However, a comprehensive basis for nonlinear modal analysis remains to be developed. In the current work, a machine learning…

Generative Adversarial Network

3D-aware Image Generation and Editing with Multi-modal Conditions

2024-03-11 · Bo Li, Yi-ke Li, Zhi-fen He, Bin Liu 외

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, …

AttributeDisentanglementImage GenerationStyle Transfer

SA-GAN: Structure-Aware GAN for Organ-Preserving Synthetic CT Generation

2021-05-14 · Hajar Emami, Ming Dong, Siamak Nejad-Davarani, Carri Glide-Hurst

In medical image synthesis, model training could be challenging due to the inconsistencies between images of different modalities even with the same patient, typically caused by internal status/tissue changes as differen…

Generative Adversarial NetworkImage GenerationOrgan Segmentation