GDO: Gradual Domain Osmosis
In this paper, we propose a new method called Gradual Domain Osmosis, which aims to solve the problem of smooth knowledge migration from source domain to target domain in Gradual Domain Adaptation (GDA). Traditional Gradual Domain Adaptation methods mitigate domain bias by introducing intermediate domains and self-training strategies, but often face the challenges of inefficient knowledge migration or missing data in intermediate domains. In this paper, we design an optimisation framework based on the hyperparameter $\lambda$ by dynamically balancing the loss weights of the source and target domains, which enables the model to progressively adjust the strength of knowledge migration ($\lambda$ incrementing from 0 to 1) during the training process, thus achieving cross-domain generalisation more efficiently. Specifically, the method incorporates self-training to generate pseudo-labels and iteratively updates the model by minimising a weighted loss function to ensure stability and robustness during progressive adaptation in the intermediate domain. The experimental part validates the effectiveness of the method on rotated MNIST, colour-shifted MNIST, portrait dataset and forest cover type dataset, and the results show that it outperforms existing baseline methods. The paper further analyses the impact of the dynamic tuning strategy of the hyperparameter $\lambda$ on the performance through ablation experiments, confirming the advantages of progressive domain penetration in mitigating the domain bias and enhancing the model generalisation capability. The study provides a theoretical support and practical framework for asymptotic domain adaptation and expands its application potential in dynamic environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationRotated MNISTSimilar Papers 제목 키워드 기반
Image Blending with Osmosis
Image blending is an integral part of many multi-image applications such as panorama stitching or remote image acquisition processes. In such scenarios, multiple images are connected at predefined boundaries to form a la…
Interpretable Fuzzy Systems For Forward Osmosis Desalination
Preserving interpretability in fuzzy rule-based systems (FRBS) is vital for water treatment, where decisions impact public health. While structural interpretability has been addressed using multi-objective algorithms, se…
Feature EngineeringDirect-drive ocean wave-powered batch reverse osmosis
Ocean waves provide a consistent, reliable source of clean energy making them a viable energy source for desalination. Ocean wave energy is useful to coastal communities, especially island nations. However, large capital…
Osmosis Distillation: Model Hijacking with the Fewest Samples
Transfer learning is devised to leverage knowledge from pre-trained models to solve new tasks with limited data and computational resources. Meanwhile, dataset distillation has emerged to synthesize a compact dataset tha…
Transfer LearningMitochondrial oxidative phosphorylation: Debunking the concepts of electron transport chain, proton pumps, chemiosmosis and rotary ATP synthesis
Herein (the first part of my work), I debunk the long-standing hypotheses that explain mitochondrial oxidative phosphorylation. Simple calculations point out that mitochondria are highly proton-deficient microcosms and t…