Supervised Domain Adaptation using Graph Embedding
Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in order to improve the performance on the small dataset (target). Among the transfer learning approaches, domain adaptation methods assume that distributions between the two domains are shifted and attempt to realign them. In this paper, we consider the domain adaptation problem from the perspective of dimensionality reduction and propose a generic framework based on graph embedding. Instead of solving the generalised eigenvalue problem, we formulate the graph-preserving criterion as a loss in the neural network and learn a domain-invariant feature transformation in an end-to-end fashion. We show that the proposed approach leads to a powerful Domain Adaptation framework; a simple LDA-inspired instantiation of the framework leads to state-of-the-art performance on two of the most widely used Domain Adaptation benchmarks, Office31 and MNIST to USPS datasets.
Code (1)
Tasks
Dimensionality ReductionDomain AdaptationGraph EmbeddingTransfer LearningSimilar Papers 제목 키워드 기반
Supervised Domain Adaptation: A Graph Embedding Perspective and a Rectified Experimental Protocol
Domain Adaptation is the process of alleviating distribution gaps between data from different domains. In this paper, we show that Domain Adaptation methods using pair-wise relationships between source and target domain …
Domain AdaptationFew-Shot LearningGraph EmbeddingBridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on Graphs
Graph neural networks (GNNs) have shown great ability for node classification on graphs. However, the success of GNNs relies on abundant labeled data, while obtaining high-quality labels is costly and challenging, especi…
Domain AdaptationLink PredictionNode ClassificationUnsupervised Domain AdaptationMulti-source Unsupervised Domain Adaptation on Graphs with Transferability Modeling
In this paper, we tackle a new problem of \textit{multi-source unsupervised domain adaptation (MSUDA) for graphs}, where models trained on annotated source domains need to be transferred to the unsupervised target graph …
Domain AdaptationMeta-LearningMulti-Source Unsupervised Domain AdaptationNode Classification+1Semi-supervised Domain Adaptation in Graph Transfer Learning
As a specific case of graph transfer learning, unsupervised domain adaptation on graphs aims for knowledge transfer from label-rich source graphs to unlabeled target graphs. However, graphs with topology and attributes u…
Domain AdaptationGRAPH DOMAIN ADAPTATIONSemi-supervised Domain AdaptationTransfer Learning+1Unsupervised Domain Adaptation of Contextual Embeddings for Low-Resource Duplicate Question Detection
Answering questions is a primary goal of many conversational systems or search products. While most current systems have focused on answering questions against structured databases or curated knowledge graphs, on-line co…
Domain AdaptationKnowledge GraphsQuestion AnsweringSelf-Supervised Learning+1