Meta-learning of semi-supervised learning from tasks with heterogeneous attribute spaces
We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space, which prevents us from learning with a wide variety of tasks. With the proposed method, the expected test performance on tasks with a small amount of labeled data is improved with unlabeled data as well as data in various tasks, where the attribute spaces are different among tasks. The proposed method embeds labeled and unlabeled data simultaneously in a task-specific space using a neural network, and the unlabeled data's labels are estimated by adapting classification or regression models in the embedding space. For the neural network, we develop variable-feature self-attention layers, which enable us to find embeddings of data with different attribute spaces with a single neural network by considering interactions among examples, attributes, and labels. Our experiments on classification and regression datasets with heterogeneous attribute spaces demonstrate that our proposed method outperforms the existing meta-learning and semi-supervised learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeMeta-LearningregressionSimilar Papers 제목 키워드 기반
Multiplex Heterogeneous Graph Convolutional Network
Heterogeneous graph convolutional networks have gained great popularity in tackling various network analytical tasks on heterogeneous network data, ranging from link prediction to node classification. However, most exist…
AttributeLink PredictionNetwork EmbeddingNode Classification+1Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning
Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requirin…
AttributeContrastive LearningGraph Neural NetworkAttributed Multi-order Graph Convolutional Network for Heterogeneous Graphs
Heterogeneous graph neural networks aim to discover discriminative node embeddings and relations from multi-relational networks.One challenge of heterogeneous graph learning is the design of learnable meta-paths, which s…
Graph LearningSemi-supervisedly Co-embedding Attributed Networks
Deep generative models (DGMs) have achieved remarkable advances. Semi-supervised variational auto-encoders (SVAE) as a classical DGM offer a principled framework to effectively generalize from small labelled data to larg…
AttributeNode ClassificationMeta-learning from Tasks with Heterogeneous Attribute Spaces
We propose a heterogeneous meta-learning method that trains a model on tasks with various attribute spaces, such that it can solve unseen tasks whose attribute spaces are different from the training tasks given a few lab…
AttributeMeta-LearningTime-Series Few-Shot Learning with Heterogeneous Channels