DefectFill: Realistic Defect Generation with Inpainting Diffusion Model for Visual Inspection

2025-03-18 · CVPR 2025 1 · Jaewoo Song, Daemin Park, Kanghyun Baek, Sangyub Lee, Jooyoung Choi, Eunji Kim, Sungroh Yoon

Developing effective visual inspection models remains challenging due to the scarcity of defect data. While image generation models have been used to synthesize defect images, producing highly realistic defects remains difficult. We propose DefectFill, a novel method for realistic defect generation that requires only a few reference defect images. It leverages a fine-tuned inpainting diffusion model, optimized with our custom loss functions incorporating defect, object, and attention terms. It enables precise capture of detailed, localized defect features and their seamless integration into defect-free objects. Additionally, our Low-Fidelity Selection method further enhances the defect sample quality. Experiments show that DefectFill generates high-quality defect images, enabling visual inspection models to achieve state-of-the-art performance on the MVTec AD dataset.

📄 PDF Abstract BibTeX arXiv:2503.13985

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

DeltaDeno: Zero-Shot Anomaly Generation via Delta-Denoising Attribution

2025-11-21 · Chaoran Xu, Chengkan Lv, Qiyu Chen, Yunkang Cao 외 arxiv

Anomaly generation is often framed as few-shot fine-tuning with anomalous samples, which contradicts the scarcity that motivates generation and tends to overfit category priors. We tackle the setting where no real anomal…

Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generation

2025-07-30 · Alexandru Buburuzan arxiv

Safety-critical applications, such as autonomous driving and medical image analysis, require extensive multimodal data for rigorous testing. Synthetic data methods are gaining prominence due to the cost and complexity of…

Synthetic Data Generation Autonomous Driving

SynSur: An end-to-end generative pipeline for synthetic industrial surface defect generation and detection

2026-04-29 · Paul Julius Kühn, Mika Pommeranz, Arjan Kuijper, Saptarshi Neil Sinha arxiv

Industrial surface defect inspection suffers from a fundamental data bottleneck: defects are rare, annotations require expert knowledge, and collecting balanced training sets is slow and costly. We present SynSur, an end…

Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting

2024-12-02 · Jacob Fein-Ashley, Benjamin Fein-Ashley

Image inpainting is a fundamental task in computer vision, aiming to restore missing or corrupted regions in images realistically. While recent deep learning approaches have significantly advanced the state-of-the-art, c…

Image Inpainting

RoadFusion: Latent Diffusion Model for Pavement Defect Detection

2025-07-21 · Muhammad Aqeel, Kidus Dagnaw Bellete, Francesco Setti arxiv

Pavement defect detection faces critical challenges including limited annotated data, domain shift between training and deployment environments, and high variability in defect appearances across different road conditions…