paper-with-me

홈 › Papers

K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality Assessment

2023-07-10 · Guoyang Xie, Jinbao Wang, Yawen Huang, Jiayi Lyu, Feng Zheng, Yefeng Zheng, Yaochu Jin

The problem of how to assess cross-modality medical image synthesis has been largely unexplored. The most used measures like PSNR and SSIM focus on analyzing the structural features but neglect the crucial lesion location and fundamental k-space speciality of medical images. To overcome this problem, we propose a new metric K-CROSS to spur progress on this challenging problem. Specifically, K-CROSS uses a pre-trained multi-modality segmentation network to predict the lesion location, together with a tumor encoder for representing features, such as texture details and brightness intensities. To further reflect the frequency-specific information from the magnetic resonance imaging principles, both k-space features and vision features are obtained and employed in our comprehensive encoders with a frequency reconstruction penalty. The structure-shared encoders are designed and constrained with a similarity loss to capture the intrinsic common structural information for both modalities. As a consequence, the features learned from lesion regions, k-space, and anatomical structures are all captured, which serve as our quality evaluators. We evaluate the performance by constructing a large-scale cross-modality neuroimaging perceptual similarity (NIRPS) dataset with 6,000 radiologist judgments. Extensive experiments demonstrate that the proposed method outperforms other metrics, especially in comparison with the radiologists on NIRPS.

📄 PDF Abstract BibTeX arXiv:2307.04296

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationSSIM

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

seg2med: a bridge from artificial anatomy to multimodal medical images

2025-04-12 · Zeyu Yang, Zhilin Chen, Yipeng Sun, Anika Strittmatter 외

We present seg2med, a modular framework for anatomy-driven multimodal medical image synthesis. The system integrates three components to enable high-fidelity, cross-modality generation of CT and MR images based on struct…

AnatomyData AugmentationDenoisingDiagnostic+3

CPGAN: Content-Parsing Generative Adversarial Networks for Text-to-Image Synthesis

2020-08-01 · ECCV 2020 8 · Jiadong Liang, Wenjie Pei, Feng Lu

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circu…

Image GenerationSemantic correspondenceTranslation

CPGAN: Full-Spectrum Content-Parsing Generative Adversarial Networks for Text-to-Image Synthesis

2019-12-18 · Jiadong Liang, Wenjie Pei, Feng Lu

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circu…

Image GenerationSemantic correspondenceTranslation

PASTA: Pathology-Aware MRI to PET Cross-Modal Translation with Diffusion Models

2024-05-27 · Yitong Li, Igor Yakushev, Dennis M. Hedderich, Christian Wachinger

Positron emission tomography (PET) is a well-established functional imaging technique for diagnosing brain disorders. However, PET's high costs and radiation exposure limit its widespread use. In contrast, magnetic reson…

Diagnostic

PRA-PoE: Robust Multimodal Alzheimer's Diagnosis with Arbitrary Missing Modalities

2026-05-13 · Guangqian Yang, Ye Du, Wenlong Hou, Qian Niu 외 arxiv

Missing modalities are prevalent in real-world Alzheimer's disease (AD) assessment and pose a significant challenge to multimodal learning, particularly when the distribution of observed modality subsets differs between …