paper-with-me

Papers

Seeking Flat Minima with Mean Teacher on Semi- and Weakly-Supervised Domain Generalization for Object Detection

2023-10-30 · Ryosuke Furuta, Yoichi Sato

Object detectors do not work well when domains largely differ between training and testing data. To overcome this domain gap in object detection without requiring expensive annotations, we consider two problem settings: semi-supervised domain generalizable object detection (SS-DGOD) and weakly-supervised DGOD (WS-DGOD). In contrast to the conventional domain generalization for object detection that requires labeled data from multiple domains, SS-DGOD and WS-DGOD require labeled data only from one domain and unlabeled or weakly-labeled data from multiple domains for training. In this paper, we show that object detectors can be effectively trained on the two settings with the same Mean Teacher learning framework, where a student network is trained with pseudo-labels output from a teacher on the unlabeled or weakly-labeled data. We provide novel interpretations of why the Mean Teacher learning framework works well on the two settings in terms of the relationships between the generalization gap and flat minima in parameter space. On the basis of the interpretations, we also show that incorporating a simple regularization method into the Mean Teacher learning framework leads to flatter minima. The experimental results demonstrate that the regularization leads to flatter minima and boosts the performance of the detectors trained with the Mean Teacher learning framework on the two settings.

📄 PDF Abstract BibTeX arXiv:2310.19351

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationDomain GeneralizationObjectobject-detectionObject DetectionUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

SWAD: Domain Generalization by Seeking Flat Minima

2021-02-17 · NeurIPS 2021 12 · Junbum Cha, Sanghyuk Chun, Kyungjae Lee, Han-Cheol Cho 외

Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows…

Domain GeneralizationGeneralization BoundsRobust classification

Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes

2024-12-18 · CVPR 2025 1 · Aodi Li, Liansheng Zhuang, Xiao Long, Minghong Yao 외

Domain generalization aims to learn a model from multiple training domains and generalize it to unseen test domains. Recent theory has shown that seeking the deep models, whose parameters lie in the flat minima of the lo…

Domain Generalization

Rethinking Sharpness-Aware Minimization as Variational Inference

2022-10-19 · Szilvia Ujváry, Zsigmond Telek, Anna Kerekes, Anna Mészáros 외

Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima. In this work, we establish connections between SAM and Mean-Field Variational Inference (MFVI) …

Variational Inference

Make Continual Learning Stronger via C-Flat

2024-04-01 · Ang Bian, Wei Li, Hangjie Yuan, Chengrong Yu 외

Model generalization ability upon incrementally acquiring dynamically updating knowledge from sequentially arriving tasks is crucial to tackle the sensitivity-stability dilemma in Continual Learning (CL). Weight loss lan…

Continual Learning

Semi-supervised classification of radiology images with NoTeacher: A Teacher that is not Mean

2021-08-10 · Balagopal Unnikrishnan, Cuong Nguyen, Shafa Balaram, Chao Li 외

Deep learning models achieve strong performance for radiology image classification, but their practical application is bottlenecked by the need for large labeled training datasets. Semi-supervised learning (SSL) approach…

Classificationimage-classificationImage ClassificationMulti-Label Classification+1