paper-with-me

홈 › Papers

PASTA: Pathology-Aware MRI to PET Cross-Modal Translation with Diffusion Models

2024-05-27 · Yitong Li, Igor Yakushev, Dennis M. Hedderich, Christian Wachinger

Positron emission tomography (PET) is a well-established functional imaging technique for diagnosing brain disorders. However, PET's high costs and radiation exposure limit its widespread use. In contrast, magnetic resonance imaging (MRI) does not have these limitations. Although it also captures neurodegenerative changes, MRI is a less sensitive diagnostic tool than PET. To close this gap, we aim to generate synthetic PET from MRI. Herewith, we introduce PASTA, a novel pathology-aware image translation framework based on conditional diffusion models. Compared to the state-of-the-art methods, PASTA excels in preserving both structural and pathological details in the target modality, which is achieved through its highly interactive dual-arm architecture and multi-modal condition integration. A cycle exchange consistency and volumetric generation strategy elevate PASTA's capability to produce high-quality 3D PET scans. Our qualitative and quantitative results confirm that the synthesized PET scans from PASTA not only reach the best quantitative scores but also preserve the pathology correctly. For Alzheimer's classification, the performance of synthesized scans improves over MRI by 4%, almost reaching the performance of actual PET. Code is available at https://github.com/ai-med/PASTA.

📄 PDF Abstract BibTeX arXiv:2405.16942

Code (1)

ai-med/pasta 공식 구현 pytorch

Tasks

Diagnostic

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Translating MRI to PET through Conditional Diffusion Models with Enhanced Pathology Awareness

2026-03-19 · Yitong Li, Igor Yakushev, Dennis M. Hedderich, Christian Wachinger arxiv

Positron emission tomography (PET) is a widely recognized technique for diagnosing neurodegenerative diseases, offering critical functional insights. However, its high costs and radiation exposure hinder its widespread u…

A Data-Efficient Pan-Tumor Foundation Model for Oncology CT Interpretation

2025-02-10 · Wenhui Lei, HanYu Chen, Zitian Zhang, Luyang Luo 외

Artificial intelligence-assisted imaging analysis has made substantial strides in tumor diagnosis and management. Here we present PASTA, a pan-tumor CT foundation model that achieves state-of-the-art performance on 45 of…

Lesion SegmentationStructured Report GenerationSurvival PredictionTransfer Learning

PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training

2022-11-05 · Zihui Gu, Ju Fan, Nan Tang, Preslav Nakov 외

Fact verification has attracted a lot of research attention recently, e.g., in journalism, marketing, and policymaking, as misinformation and disinformation online can sway one's opinion and affect one's actions. While f…

Fact CheckingFact VerificationLanguage ModellingMarketing+3

Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology

2026-06-16 · Tianyu Liu, Ziqing Wang, Zhaokang Liang, Tong Ding 외 arxiv

Predicting immune biomarkers associated with the tumor immune microenvironment (TIME) is critical for advancing precision oncology, yet existing approaches are largely limited to single image modalities and suffer from i…

VideoPASTA: 7K Preference Pairs That Matter for Video-LLM Alignment

2025-04-18 · Yogesh Kulkarni, Pooyan Fazli

Video-language models (Video-LLMs) excel at understanding video content but struggle with spatial relationships, temporal ordering, and cross-frame continuity. To address these limitations, we introduce VideoPASTA (Prefe…

MVBench