paper-with-me

Papers

Two stages domain invariant representation learners solve the large co-variate shift in unsupervised domain adaptation with two dimensional data domains

2024-12-06 · Hisashi Oshima, Tsuyoshi Ishizone, Tomoyuki Higuchi

Recent developments in the unsupervised domain adaptation (UDA) enable the unsupervised machine learning (ML) prediction for target data, thus this will accelerate real world applications with ML models such as image recognition tasks in self-driving. Researchers have reported the UDA techniques are not working well under large co-variate shift problems where e.g. supervised source data consists of handwritten digits data in monotone color and unsupervised target data colored digits data from the street view. Thus there is a need for a method to resolve co-variate shift and transfer source labelling rules under this dynamics. We perform two stages domain invariant representation learning to bridge the gap between source and target with semantic intermediate data (unsupervised). The proposed method can learn domain invariant features simultaneously between source and intermediate also intermediate and target. Finally this achieves good domain invariant representation between source and target plus task discriminability owing to source labels. This induction for the gradient descent search greatly eases learning convergence in terms of classification performance for target data even when large co-variate shift. We also derive a theorem for measuring the gap between trained models and unsupervised target labelling rules, which is necessary for the free parameters optimization. Finally we demonstrate that proposing method is superiority to previous UDA methods using 4 representative ML classification datasets including 38 UDA tasks. Our experiment will be a basis for challenging UDA problems with large co-variate shift.

📄 PDF Abstract BibTeX arXiv:2412.04682

Code (1)

oh-yu/domain-invariant-learning 공식 구현 pytorch

Tasks

Domain AdaptationRepresentation LearningUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Aligning Domain-specific Distribution and Classifier for Cross-domain Classification from Multiple Sources

2022-01-04 · Yongchun Zhu, Fuzhen Zhuang, Deqing Wang

While Unsupervised Domain Adaptation (UDA) algorithms, i.e., there are only labeled data from source domains, have been actively studied in recent years, most algorithms and theoretical results focus on Single-source Uns…

Domain Adaptationdomain classificationimage-classificationImage Classification+2

Behavior-Aware Item Modeling via Dynamic Procedural Solution Representations for Knowledge Tracing

2026-04-09 · Jun Seo, Sangwon Ryu, Heejin Do, Hyounghun Kim 외 arxiv

Knowledge Tracing (KT) aims to predict learners' future performance from past interactions. While recent KT approaches have improved via learning item representations aligned with Knowledge Components, they overlook the …

Knowledge Tracing

Large Language Models are In-Context Molecule Learners

2024-03-07 · Jiatong Li, Wei Liu, Zhihao Ding, Wenqi Fan 외

Large Language Models (LLMs) have demonstrated exceptional performance in biochemical tasks, especially the molecule caption translation task, which aims to bridge the gap between molecules and natural language texts. Ho…

Cross-Modal RetrievalIn-Context LearningRe-RankingRetrieval+1

Learning First-Order Symbolic Representations for Planning from the Structure of the State Space

2019-09-12 · Blai Bonet, Hector Geffner

One of the main obstacles for developing flexible AI systems is the split between data-based learners and model-based solvers. Solvers such as classical planners are very flexible and can deal with a variety of problem i…

Representation Learning

Domain Invariant Representation Learning and Sleep Dynamics Modeling for Automatic Sleep Staging

2023-12-06 · Seungyeon Lee, Thai-Hoang Pham, Zhao Cheng, Ping Zhang

Sleep staging has become a critical task in diagnosing and treating sleep disorders to prevent sleep related diseases. With growing large scale sleep databases, significant progress has been made toward automatic sleep s…

EEGRepresentation LearningSleep StagingUncertainty Quantification