VALD-MD: Visual Attribution via Latent Diffusion for Medical Diagnostics
Visual attribution in medical imaging seeks to make evident the diagnostically-relevant components of a medical image, in contrast to the more common detection of diseased tissue deployed in standard machine vision pipelines (which are less straightforwardly interpretable/explainable to clinicians). We here present a novel generative visual attribution technique, one that leverages latent diffusion models in combination with domain-specific large language models, in order to generate normal counterparts of abnormal images. The discrepancy between the two hence gives rise to a mapping indicating the diagnostically-relevant image components. To achieve this, we deploy image priors in conjunction with appropriate conditioning mechanisms in order to control the image generative process, including natural language text prompts acquired from medical science and applied radiology. We perform experiments and quantitatively evaluate our results on the COVID-19 Radiography Database containing labelled chest X-rays with differing pathologies via the Frechet Inception Distance (FID), Structural Similarity (SSIM) and Multi Scale Structural Similarity Metric (MS-SSIM) metrics obtained between real and generated images. The resulting system also exhibits a range of latent capabilities including zero-shot localized disease induction, which are evaluated with real examples from the cheXpert dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
MS-SSIMSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Valdi: Value Diffusion World Models
World models can enable Model Predictive Control (MPC), but this requires dynamics prediction that is both fast enough for online use and expressive enough to represent uncertain futures. Diffusion models offer a natural…
EvaLDA: Efficient Evasion Attacks Towards Latent Dirichlet Allocation
As one of the most powerful topic models, Latent Dirichlet Allocation (LDA) has been used in a vast range of tasks, including document understanding, information retrieval and peer-reviewer assignment. Despite its tremen…
document understandingInformation RetrievalRetrievalSentiment Analysis+1VALD-GAN: video anomaly detection using latent discriminator augmented GAN
The most crucial and difficult challenge for intelligent video surveillance is to identify anomalies in a video that comprises anomalous behavior or occurrences. The ambiguous definition of the anomaly makes the detectio…
Anomaly DetectionAnomaly Detection In Surveillance VideosVideo Anomaly DetectionI2AM: Interpreting Image-to-Image Latent Diffusion Models via Attribution Maps
Large-scale diffusion models have made significant advancements in the field of image generation, especially through the use of cross-attention mechanisms that guide image formation based on textual descriptions. While t…
Image AttributionImage GenerationImage InpaintingThe Journey, Not the Destination: How Data Guides Diffusion Models
Diffusion models trained on large datasets can synthesize photo-realistic images of remarkable quality and diversity. However, attributing these images back to the training data-that is, identifying specific training exa…
DenoisingDiversity