paper-with-me

Papers

When Unseen Domain Generalization is Unnecessary? Rethinking Data Augmentation

2019-06-07 · Ling Zhang, Xiaosong Wang, Dong Yang, Thomas Sanford, Stephanie Harmon, Baris Turkbey, Holger Roth, Andriy Myronenko, Daguang Xu, Ziyue Xu

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including different imaging protocols, device vendors and patient populations. Here we consider the problem of domain generalization, when a model is trained once, and its performance generalizes to unseen domains. Intuitively, within a specific medical imaging modality the domain differences are smaller relative to natural images domain variability. We rethink data augmentation for medical 3D images and propose a deep stacked transformations (DST) approach for domain generalization. Specifically, a series of n stacked transformations are applied to each image in each mini-batch during network training to account for the contribution of domain-specific shifts in medical images. We comprehensively evaluate our method on three tasks: segmentation of whole prostate from 3D MRI, left atrial from 3D MRI, and left ventricle from 3D ultrasound. We demonstrate that when trained on a small source dataset, (i) on average, DST models on unseen datasets degrade only by 11% (Dice score change), compared to the conventional augmentation (degrading 39%) and CycleGAN-based domain adaptation method (degrading 25%); (ii) when evaluation on the same domain, DST is also better albeit only marginally. (iii) When training on large-sized data, DST on unseen domains reaches performance of state-of-the-art fully supervised models. These findings establish a strong benchmark for the study of domain generalization in medical imaging, and can be generalized to the design of robust deep segmentation models for clinical deployment.

📄 PDF Abstract BibTeX arXiv:1906.03347

Code (1)

Daividao/semantic-segmentation-deeplearning tf

Tasks

Data AugmentationDomain AdaptationDomain GeneralizationImage SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Rethinking the Evaluation Protocol of Domain Generalization

2023-05-24 · CVPR 2024 1 · Han Yu, Xingxuan Zhang, Renzhe Xu, Jiashuo Liu 외

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately eval…

Domain GeneralizationModel Selection

Domain Generalization in Biosignal Classification

2020-11-12 · Theekshana Dissanayake, Tharindu Fernando, Simon Denman, Houman Ghaemmaghami 외

Objective: When training machine learning models, we often assume that the training data and evaluation data are sampled from the same distribution. However, this assumption is violated when the model is evaluated on ano…

ClassificationDomain AdaptationDomain GeneralizationGeneral Classification

Sparse Masked Attention Policies for Reliable Generalization

2026-02-23 · Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan 외 arxiv

In reinforcement learning, abstraction methods that remove unnecessary information from the observation are commonly used to learn policies which generalize better to unseen tasks. However, these methods often overlook a…

Reinforcement Learning

Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment

2023-03-23 · CVPR 2023 1 · Yiyou Sun, Yaojie Liu, Xiaoming Liu, Yixuan Li 외

This work studies the generalization issue of face anti-spoofing (FAS) models on domain gaps, such as image resolution, blurriness and sensor variations. Most prior works regard domain-specific signals as a negative impa…

Domain GeneralizationFace Anti-SpoofingMetric Learning

When and How Does CLIP Enable Domain and Compositional Generalization?

2025-02-13 · Elias Kempf, Simon Schrodi, Max Argus, Thomas Brox

The remarkable generalization performance of contrastive vision-language models like CLIP is often attributed to the diversity of their training distributions. However, key questions remain unanswered: Can CLIP generaliz…

DiversityDomain Generalization