paper-with-me

Papers

MRGen: Diffusion-based Controllable Data Engine for MRI Segmentation towards Unannotated Modalities

2024-12-04 · HaoNing Wu, Ziheng Zhao, Ya zhang, Weidi Xie, Yanfeng Wang

Medical image segmentation has recently demonstrated impressive progress with deep neural networks, yet the heterogeneous modalities and scarcity of mask annotations limit the development of segmentation models on unannotated modalities. This paper investigates a new paradigm for leveraging generative models in medical applications: controllably synthesizing data for unannotated modalities, without requiring registered data pairs. Specifically, we make the following contributions in this paper: (i) we collect and curate a large-scale radiology image-text dataset, MedGen-1M, comprising modality labels, attributes, region, and organ information, along with a subset of organ mask annotations, to support research in controllable medical image generation; (ii) we propose a diffusion-based data engine, termed MRGen, which enables generation conditioned on text prompts and masks, synthesizing MR images for diverse modalities lacking mask annotations, to train segmentation models on unannotated modalities; (iii) we conduct extensive experiments across various modalities, illustrating that our data engine can effectively synthesize training samples and extend MRI segmentation towards unannotated modalities.

📄 PDF Abstract BibTeX arXiv:2412.04106

Code (1)

haoningwu3639/MRGen 공식 구현 pytorch

Tasks

Image GenerationImage SegmentationMedical Image GenerationMedical Image SegmentationMRI segmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Reinforcement Learning with Imbalanced Dataset for Data-to-Text Medical Report Generation

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Toru Nishino, Ryota Ozaki, Yohei Momoki, Tomoki Taniguchi 외

Automated generation of medical reports that describe the findings in the medical images helps radiologists by alleviating their workload. Medical report generation system should generate correct and concise reports. How…

Data AugmentationMedical Report Generationreinforcement-learningReinforcement Learning+1

MRGEN: A Conceptual Framework for LLM-Powered Mixed Reality Authoring Tools for Education

2026-03-12 · Mohammed Oussama Seddini, Mohamed Ez-Zaouia, Ngoc Luyen Le, Iza Marfisi arxiv

Mixed Reality (MR) offers immersive and multimodal opportunities for education but remains difficult for teachers to author without technical expertise. We propose MRGEN, a conceptual framework for LLM-powered authoring …

A Real-Calibrated Synthetic-First Data Engine

2026-05-10 · Yukang Shen arxiv

Modern computer vision systems increasingly encounter performance limitations in data-scarce domains, where collecting large-scale, high-quality labeled data is costly or impractical. While controllable diffusion models …

Data AugmentationImage GenerationPose Estimation

MMFace-DiT: A Dual-Stream Diffusion Transformer for High-Fidelity Multimodal Face Generation

2026-03-30 · Bharath Krishnamurthy, Ajita Rattani arxiv

Recent multimodal face generation models address the spatial control limitations of text-to-image diffusion models by augmenting text-based conditioning with spatial priors such as segmentation masks, sketches, or edge m…

OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding

2025-04-15 · Dianbing Xi, Jiepeng Wang, Yuanzhi Liang, Xi Qiu 외

In this paper, we propose a novel framework for controllable video diffusion, OmniVDiff, aiming to synthesize and comprehend multiple video visual content in a single diffusion model. To achieve this, OmniVDiff treats al…

Semantic SegmentationVideo GenerationVideo Understanding