A Theory of Learning Unified Model via Knowledge Integration from Label Space Varying Domains
Existing domain adaptation systems can hardly be applied to real-world problems with new classes presenting at deployment time, especially regarding source-free scenarios where multiple source domains do not share the label space despite being given a few labeled target data. To address this, we consider a challenging problem: multi-source semi-supervised open-set domain adaptation and propose a learning theory via joint error, effectively tackling strong domain shift. To generalize the algorithm into source-free cases, we introdcue a computationally efficient and architecture-flexible attention-based feature generation module. Extensive experiments on various data sets demonstrate the significant improvement of our proposed algorithm over baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationLearning TheorySimilar Papers 제목 키워드 기반
Categorical semiotics: Foundations for Knowledge Integration
The integration of knowledge extracted from diverse models, whether described by domain experts or generated by machine learning algorithms, has historically been challenged by the absence of a suitable framework for spe…
Learning From Biased Soft Labels
Knowledge distillation has been widely adopted in a variety of tasks and has achieved remarkable successes. Since its inception, many researchers have been intrigued by the dark knowledge hidden in the outputs of the tea…
Knowledge DistillationToken Space: A Category Theory Framework for AI Computations
This paper introduces the Token Space framework, a novel mathematical construct designed to enhance the interpretability and effectiveness of deep learning models through the application of category theory. By establishi…
Deep LearningConsciousness and Automated Reasoning
This paper aims at demonstrating how a first-order logic reasoning system in combination with a large knowledge base can be understood as an artificial consciousness system. For this we review some aspects from the area …
PhilosophyUnicorn: A Unified Multi-tasking Model for Supporting Matching Tasks in Data Integration
Data matching - which decides whether two data elements (e.g., string, tuple, column, or knowledge graph entity) are the "same" (a.k.a. a match) - is a key concept in data integration, such as entity matching and schema …
Data IntegrationEntity ResolutionMixture-of-ExpertsZero-Shot Learning