Hyper-Process Model: A Zero-Shot Learning algorithm for Regression Problems based on Shape Analysis
Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer vision community where a new unseen image needs to be correctly classified, assuming the target class was not used in the training procedure. Apart from image classification, only a couple of generic methods were proposed that are applicable to both classification and regression. These learn the relation among model coefficients so new ones can be predicted according to provided conditions. So far, up to our knowledge, no methods exist that are applicable only to regression, and take advantage from such setting. Therefore, the present work proposes a novel algorithm for regression problems that uses data drawn from trained models, instead of model coefficients. In this case, a shape analyses on the data is performed to create a statistical shape model and generate new shapes to train new models. The proposed algorithm is tested in a theoretical setting using the beta distribution where main problem to solve is to estimate a function that predicts curves, based on already learned different, but related ones.
Code (2)
Tasks
General Classificationimage-classificationImage ClassificationregressionZero-Shot LearningSimilar Papers 제목 키워드 기반
Zero-shot Transfer Learning for Gray-box Hyper-parameter Optimization
Zero-shot hyper-parameter optimization refers to the process of selecting hyper- parameter configurations that are expected to perform well for a given dataset upfront, without access to any observations of the losses of…
Bayesian OptimizationTransfer LearningPractical and sample efficient zero-shot HPO
Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given…
AutoMLHyperparameter OptimizationTransfer LearningMeta-Learning via Classifier(-free) Diffusion Guidance
We introduce meta-learning algorithms that perform zero-shot weight-space adaptation of neural network models to unseen tasks. Our methods repurpose the popular generative image synthesis techniques of natural language g…
Few-Shot LearningImage GenerationMeta-LearningVisual Question Answering (VQA)+1HyperHawkes: Hypernetwork based Neural Temporal Point Process
Temporal point process serves as an essential tool for modeling time-to-event data in continuous time space. Despite having massive amounts of event sequence data from various domains like social media, healthcare etc., …
Continual LearningZero-Shot LearningDirect side information learning for zero-shot regression
Zero-shot learning provides models for targets for which instances are not available, commonly called unobserved targets. The availability of target side information becomes crucial in this context in order to properly i…
global-optimizationimage-classificationImage Classificationregression+2