paper-with-me

홈 › Papers

How does the Combined Risk Affect the Performance of Unsupervised Domain Adaptation Approaches?

2020-12-30 · Li Zhong, Zhen Fang, Feng Liu, Jie Lu, Bo Yuan, Guangquan Zhang

Unsupervised domain adaptation (UDA) aims to train a target classifier with labeled samples from the source domain and unlabeled samples from the target domain. Classical UDA learning bounds show that target risk is upper bounded by three terms: source risk, distribution discrepancy, and combined risk. Based on the assumption that the combined risk is a small fixed value, methods based on this bound train a target classifier by only minimizing estimators of the source risk and the distribution discrepancy. However, the combined risk may increase when minimizing both estimators, which makes the target risk uncontrollable. Hence the target classifier cannot achieve ideal performance if we fail to control the combined risk. To control the combined risk, the key challenge takes root in the unavailability of the labeled samples in the target domain. To address this key challenge, we propose a method named E-MixNet. E-MixNet employs enhanced mixup, a generic vicinal distribution, on the labeled source samples and pseudo-labeled target samples to calculate a proxy of the combined risk. Experiments show that the proxy can effectively curb the increase of the combined risk when minimizing the source risk and distribution discrepancy. Furthermore, we show that if the proxy of the combined risk is added into loss functions of four representative UDA methods, their performance is also improved.

📄 PDF Abstract BibTeX arXiv:2101.01104

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Covert Attacks on Machine Learning Training in Passively Secure MPC

2025-05-21 · Matthew Jagielski, Daniel Escudero, Rahul Rachuri, Peter Scholl

Secure multiparty computation (MPC) allows data owners to train machine learning models on combined data while keeping the underlying training data private. The MPC threat model either considers an adversary who passivel…

Impact of the political risk on food reserve ratio: evidence across countries

2022-06-24 · Kai Xing, Shang Li, Xiaoguang Yang

Using an unbalanced panel data covering 75 countries from 1991 to 2019, we explore how the political risk impacts on food reserve ratio. The empirical findings show that an increasing political risk negatively affect foo…

When Does Unsupervised Machine Translation Work?

2020-04-12 · WMT (EMNLP) 2020 11 · Kelly Marchisio, Kevin Duh, Philipp Koehn

Despite the reported success of unsupervised machine translation (MT), the field has yet to examine the conditions under which these methods succeed, and where they fail. We conduct an extensive empirical evaluation of u…

Machine TranslationTranslationUnsupervised Machine Translation

More Communication Does Not Result in Smaller Generalization Error in Federated Learning

2023-04-24 · Romain Chor, Milad Sefidgaran, Abdellatif Zaidi

We study the generalization error of statistical learning models in a Federated Learning (FL) setting. Specifically, there are $K$ devices or clients, each holding an independent own dataset of size $n$. Individual model…

Federated Learning

Wideband mmWave Massive MIMO Channel Estimation and Localization

2022-09-18 · Shudi Weng, Fan Jiang, Henk Wymeersch

Spatial wideband effects are known to affect channel estimation and localization performance in millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems. Based on perturbation analysis, we show that…