Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy
Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal replicate structure of two novel single-cell fluorescent microscopy datasets, we propose generally applicable tests to assess the extent to which models learn causal representations across increasingly challenging levels of OOD-generalization. We show that despite seemingly strong performance, as assessed by other established metrics, both naive and contemporary baselines designed to ward against confounding, collapse on these tests. We introduce a new method, Interventional Style Transfer (IST), that substantially improves OOD generalization by generating interventional training distributions in which spurious correlations between biological causes and nuisances are mitigated. We publish our code and datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Out-of-Distribution GeneralizationStyle TransferSimilar Papers 제목 키워드 기반
Complex Style Image Transformations for Domain Generalization in Medical Images
The absence of well-structured large datasets in medical computer vision results in decreased performance of automated systems and, especially, of deep learning models. Domain generalization techniques aim to approach un…
Domain GeneralizationSemantic SegmentationStyle TransferEstimating Joint interventional distributions from marginal interventional data
In this paper we show how to exploit interventional data to acquire the joint conditional distribution of all the variables using the Maximum Entropy principle. To this end, we extend the Causal Maximum Entropy method to…
feature selectionMixStyle Neural Networks for Domain Generalization and Adaptation
Neural networks do not generalize well to unseen data with domain shifts -- a longstanding problem in machine learning and AI. To overcome the problem, we propose MixStyle, a simple plug-and-play, parameter-free module t…
Data AugmentationDomain AdaptationDomain GeneralizationObject Recognition+5Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
Domain generalization (DG) has been a hot topic in image recognition, with a goal to train a general model that can perform well on unseen domains. Recently, federated learning (FL), an emerging machine learning paradigm…
Domain GeneralizationFederated LearningStyle TransferNon-Parametric Style Transfer
Recent feed-forward neural methods of arbitrary image style transfer mainly utilized encoded feature map upto its second-order statistics, i.e., linearly transformed the encoded feature map of a content image to have the…
DecoderStyle Transfer