MLA-BIN: Model-level Attention and Batch-instance Style Normalization for Domain Generalization of Federated Learning on Medical Image Segmentation

2023-06-29 · Fubao Zhu, Yanhui Tian, Chuang Han, Yanting Li, Jiaofen Nan, Ni Yao, Weihua Zhou

The privacy protection mechanism of federated learning (FL) offers an effective solution for cross-center medical collaboration and data sharing. In multi-site medical image segmentation, each medical site serves as a client of FL, and its data naturally forms a domain. FL supplies the possibility to improve the performance of seen domains model. However, there is a problem of domain generalization (DG) in the actual de-ployment, that is, the performance of the model trained by FL in unseen domains will decrease. Hence, MLA-BIN is proposed to solve the DG of FL in this study. Specifically, the model-level attention module (MLA) and batch-instance style normalization (BIN) block were designed. The MLA represents the unseen domain as a linear combination of seen domain models. The atten-tion mechanism is introduced for the weighting coefficient to obtain the optimal coefficient ac-cording to the similarity of inter-domain data features. MLA enables the global model to gen-eralize to unseen domain. In the BIN block, batch normalization (BN) and instance normalization (IN) are combined to perform the shallow layers of the segmentation network for style normali-zation, solving the influence of inter-domain image style differences on DG. The extensive experimental results of two medical image seg-mentation tasks demonstrate that the proposed MLA-BIN outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2306.17008

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Generalization Federated Learning Image Segmentation Medical Image Segmentation Semantic Segmentation

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…

Meta Batch-Instance Normalization for Generalizable Person Re-Identification

2020-11-30 · CVPR 2021 1 · Seokeon Choi, Taekyung Kim, Minki Jeong, Hyoungseob Park 외

Although supervised person re-identification (Re-ID) methods have shown impressive performance, they suffer from a poor generalization capability on unseen domains. Therefore, generalizable Re-ID has recently attracted g…

Data Augmentation Domain Generalization Generalizable Person Re-identification Meta-Learning+2

Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks

2018-05-21 · NeurIPS 2018 12 · Hyeonseob Nam, Hyo-Eun Kim

Real-world image recognition is often challenged by the variability of visual styles including object textures, lighting conditions, filter effects, etc. Although these variations have been deemed to be implicitly handle…

Style Transfer

Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise

2019-08-12 · Senwei Liang, Zhongzhan Huang, Mingfu Liang, Haizhao Yang

Batch Normalization (BN)(Ioffe and Szegedy 2015) normalizes the features of an input image via statistics of a batch of images and hence BN will bring the noise to the gradient of the training loss. Previous works indica…

image-classification Image Classification

SAFIN: Arbitrary Style Transfer With Self-Attentive Factorized Instance Normalization

2021-05-13 · Aaditya Singh, Shreeshail Hingane, Xinyu Gong, Zhangyang Wang

Artistic style transfer aims to transfer the style characteristics of one image onto another image while retaining its content. Existing approaches commonly leverage various normalization techniques, although these face …