paper-with-me

Papers

Enhanced Generative Data Augmentation for Semantic Segmentation via Stronger Guidance

2024-09-09 · Quang-Huy Che, Duc-Tri Le, Bich-Nga Pham, Duc-Khai Lam, Vinh-Tiep Nguyen

Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips, create new images but often lack diversity along key semantic dimensions and fail to alter high-level semantic properties. To address this issue, generative models have emerged as an effective solution for augmenting data by generating synthetic images. Controllable Generative models offer data augmentation methods for semantic segmentation tasks by using prompts and visual references from the original image. However, these models face challenges in generating synthetic images that accurately reflect the content and structure of the original image due to difficulties in creating effective prompts and visual references. In this work, we introduce an effective data augmentation pipeline for semantic segmentation using Controllable Diffusion model. Our proposed method includes efficient prompt generation using \textit{Class-Prompt Appending} and \textit{Visual Prior Blending} to enhance attention to labeled classes in real images, allowing the pipeline to generate a precise number of augmented images while preserving the structure of segmentation-labeled classes. In addition, we implement a \textit{class balancing algorithm} to ensure a balanced training dataset when merging the synthetic and original images. Evaluation on PASCAL VOC datasets, our pipeline demonstrates its effectiveness in generating high-quality synthetic images for semantic segmentation. Our code is available at \href{https://github.com/chequanghuy/Enhanced-Generative-Data-Augmentation-for-Semantic-Segmentation-via-Stronger-Guidance}{this https URL}.

📄 PDF Abstract BibTeX arXiv:2409.06002

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

R&D: Balancing Reliability and Diversity in Synthetic Data Augmentation for Semantic Segmentation

2026-03-19 · Huy Che, Dinh-Duy Phan, Duc-Khai Lam arxiv

Collecting and annotating datasets for pixel-level semantic segmentation tasks are highly labor-intensive. Data augmentation provides a viable solution by enhancing model generalization without additional real-world data…

Semantic SegmentationData Augmentation

Pixel Level Data Augmentation for Semantic Image Segmentation using Generative Adversarial Networks

2018-11-01 · Shuangting Liu, Jia-Qi Zhang, Yuxin Chen, Yifan Liu 외

Semantic segmentation is one of the basic topics in computer vision, it aims to assign semantic labels to every pixel of an image. Unbalanced semantic label distribution could have a negative influence on segmentation ac…

Data AugmentationImage SegmentationSegmentationSemantic Segmentation

ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation

2023-11-28 · Jacob Schnell, Jieke Wang, Lu Qi, Vincent Tao Hu 외

Recent advances in generative models, such as diffusion models, have made generating high-quality synthetic images widely accessible. Prior works have shown that training on synthetic images improves many perception task…

Data Augmentationimage-classificationImage Classificationobject-detection+3

An Unpaired Cross-modality Segmentation Framework Using Data Augmentation and Hybrid Convolutional Networks for Segmenting Vestibular Schwannoma and Cochlea

2022-11-28 · Yuzhou Zhuang, Hong Liu, Enmin Song, Coskun Cetinkaya 외

The crossMoDA challenge aims to automatically segment the vestibular schwannoma (VS) tumor and cochlea regions of unlabeled high-resolution T2 scans by leveraging labeled contrast-enhanced T1 scans. The 2022 edition exte…

Data AugmentationSegmentation

GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation

2025-01-18 · Yannik Frisch, Christina Bornberg, Moritz Fuchs, Anirban Mukhopadhyay

Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask)…

SegmentationSemantic Segmentation