paper-with-me

Papers

Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models

2024-07-19 · Hyun-Jic Oh, Won-Ki Jeong

In the field of computational pathology, deep learning algorithms have made significant progress in tasks such as nuclei segmentation and classification. However, the potential of these advanced methods is limited by the lack of available labeled data. Although image synthesis via recent generative models has been actively explored to address this challenge, existing works have barely addressed label augmentation and are mostly limited to single-class and unconditional label generation. In this paper, we introduce a novel two-stage framework for multi-class nuclei data augmentation using text-conditional diffusion models. In the first stage, we innovate nuclei label synthesis by generating multi-class semantic labels and corresponding instance maps through a joint diffusion model conditioned by text prompts that specify the label structure information. In the second stage, we utilize a semantic and text-conditional latent diffusion model to efficiently generate high-quality pathology images that align with the generated nuclei label images. We demonstrate the effectiveness of our method on large and diverse pathology nuclei datasets, with evaluations including qualitative and quantitative analyses, as well as assessments of downstream tasks.

📄 PDF Abstract BibTeX arXiv:2407.14426

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationImage Generation

Methods 이 논문이 사용한 방법론

Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

DiffMix: Diffusion Model-based Data Synthesis for Nuclei Segmentation and Classification in Imbalanced Pathology Image Datasets

2023-06-25 · Hyun-Jic Oh, Won-Ki Jeong

Nuclei segmentation and classification is a significant process in pathology image analysis. Deep learning-based approaches have greatly contributed to the higher accuracy of this task. However, those approaches suffer f…

ClassificationNuclei ClassificationSegmentation

Nuclei instance segmentation and classification in histopathology images with StarDist

2022-03-03 · Martin Weigert, Uwe Schmidt

Instance segmentation and classification of nuclei is an important task in computational pathology. We show that StarDist, a deep learning nuclei segmentation method originally developed for fluorescence microscopy, can …

ClassificationInstance SegmentationSegmentationSemantic Segmentation

GradMix for nuclei segmentation and classification in imbalanced pathology image datasets

2022-10-24 · Tan Nhu Nhat Doan, Kyungeun Kim, Boram Song, Jin Tae Kwak

An automated segmentation and classification of nuclei is an essential task in digital pathology. The current deep learning-based approaches require a vast amount of annotated datasets by pathologists. However, the exist…

ClassificationData AugmentationSegmentation

Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images

2018-09-29 · Faisal Mahmood, Daniel Borders, Richard Chen, Gregory N. McKay 외

Nuclei segmentation is a fundamental task that is critical for various computational pathology applications including nuclei morphology analysis, cell type classification, and cancer grading. Conventional vision-based me…

Generative Adversarial NetworkSegmentationStructured Prediction

DeNuC: Decoupling Nuclei Detection and Classification in Histopathology

2026-03-04 · Zijiang Yang, Chen Kuang, Dongmei Fu arxiv

Pathology Foundation Models (FMs) have shown strong performance across a wide range of pathology image representation and diagnostic tasks. However, FMs do not exhibit the expected performance advantage over traditional …