paper-with-me

Papers

MRI Image Generation Based on Text Prompts

2025-05-23 · Xinxian Fan, Mengye Lyu

This study explores the use of text-prompted MRI image generation with the Stable Diffusion (SD) model to address challenges in acquiring real MRI datasets, such as high costs, limited rare case samples, and privacy concerns. The SD model, pre-trained on natural images, was fine-tuned using the 3T fastMRI dataset and the 0.3T M4Raw dataset, with the goal of generating brain T1, T2, and FLAIR images across different magnetic field strengths. The performance of the fine-tuned model was evaluated using quantitative metrics,including Fr\'echet Inception Distance (FID) and Multi-Scale Structural Similarity (MS-SSIM), showing improvements in image quality and semantic consistency with the text prompts. To further evaluate the model's potential, a simple classification task was carried out using a small 0.35T MRI dataset, demonstrating that the synthetic images generated by the fine-tuned SD model can effectively augment training datasets and improve the performance of MRI constrast classification tasks. Overall, our findings suggest that text-prompted MRI image generation is feasible and can serve as a useful tool for medical AI applications.

📄 PDF Abstract BibTeX arXiv:2505.22682

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationMS-SSIMSSIM

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generation

2023-11-20 · Shachar Rosenman, Vasudev Lal, Phillip Howard

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPr…

Image GenerationLanguage ModelingLanguage ModellingPrompt Engineering+2

UNIMO-G: Unified Image Generation through Multimodal Conditional Diffusion

2024-01-24 · Wei Li, Xue Xu, Jiachen Liu, Xinyan Xiao

Existing text-to-image diffusion models primarily generate images from text prompts. However, the inherent conciseness of textual descriptions poses challenges in faithfully synthesizing images with intricate details, su…

Conditional Image GenerationDenoisingImage GenerationImage Segmentation+6

Optimizing Negative Prompts for Enhanced Aesthetics and Fidelity in Text-To-Image Generation

2024-03-12 · Michael Ogezi, Ning Shi

In text-to-image generation, using negative prompts, which describe undesirable image characteristics, can significantly boost image quality. However, producing good negative prompts is manual and tedious. To address thi…

Image GenerationText to Image GenerationText-to-Image Generation

SafeText: Safe Text-to-image Models via Aligning the Text Encoder

2025-02-28 · Yuepeng Hu, Zhengyuan Jiang, Neil Zhenqiang Gong

Text-to-image models can generate harmful images when presented with unsafe prompts, posing significant safety and societal risks. Alignment methods aim to modify these models to ensure they generate only non-harmful ima…

Image Generation

A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesis

2024-02-20 · Nailei Hei, Qianyu Guo, ZiHao Wang, Yan Wang 외

Well-designed prompts have demonstrated the potential to guide text-to-image models in generating amazing images. Although existing prompt engineering methods can provide high-level guidance, it is challenging for novice…

Image GenerationPrompt EngineeringText Generation