paper-with-me

홈 › Papers

Domain Adaptation: Learning Bounds and Algorithms

2009-02-19 · Yishay Mansour, Mehryar Mohri, Afshin Rostamizadeh

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by Ben-David et al. (2007), we introduce a novel distance between distributions, discrepancy distance, that is tailored to adaptation problems with arbitrary loss functions. We give Rademacher complexity bounds for estimating the discrepancy distance from finite samples for different loss functions. Using this distance, we derive novel generalization bounds for domain adaptation for a wide family of loss functions. We also present a series of novel adaptation bounds for large classes of regularization-based algorithms, including support vector machines and kernel ridge regression based on the empirical discrepancy. This motivates our analysis of the problem of minimizing the empirical discrepancy for various loss functions for which we also give novel algorithms. We report the results of preliminary experiments that demonstrate the benefits of our discrepancy minimization algorithms for domain adaptation.

📄 PDF Abstract BibTeX arXiv:0902.3430

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGeneralization Bounds

Similar Papers 제목 키워드 기반

Adversarial Multiple Source Domain Adaptation

2018-12-01 · NeurIPS 2018 12 · Han Zhao, Shanghang Zhang, Guanhang Wu, José M. F. Moura 외

While domain adaptation has been actively researched, most algorithms focus on the single-source-single-target adaptation setting. In this paper we propose new generalization bounds and algorithms under both classificati…

ClassificationDomain AdaptationGeneral ClassificationGeneralization Bounds+3

Best-Effort Adaptation

2023-05-10 · Pranjal Awasthi, Corinna Cortes, Mehryar Mohri

We study a problem of best-effort adaptation motivated by several applications and considerations, which consists of determining an accurate predictor for a target domain, for which a moderate amount of labeled samples a…

Domain Adaptation

On generalization in moment-based domain adaptation

2020-02-19 · Werner Zellinger, Bernhard A. Moser, Susanne Saminger-Platz

Domain adaptation algorithms are designed to minimize the misclassification risk of a discriminative model for a target domain with little training data by adapting a model from a source domain with a large amount of tra…

Domain AdaptationGeneralization Bounds

Moment-Based Domain Adaptation: Learning Bounds and Algorithms

2020-04-22 · Werner Zellinger

This thesis contributes to the mathematical foundation of domain adaptation as emerging field in machine learning. In contrast to classical statistical learning, the framework of domain adaptation takes into account devi…

BIG-bench Machine LearningDomain Adaptation

Adaptation Algorithm and Theory Based on Generalized Discrepancy

2014-05-07 · Corinna Cortes, Mehryar Mohri, Andres Muñoz Medina

We present a new algorithm for domain adaptation improving upon a discrepancy minimization algorithm previously shown to outperform a number of algorithms for this task. Unlike many previous algorithms for domain adaptat…

Domain Adaptation