HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learning
In this work we propose a HyperTransformer, a Transformer-based model for supervised and semi-supervised few-shot learning that generates weights of a convolutional neural network (CNN) directly from support samples. Since the dependence of a small generated CNN model on a specific task is encoded by a high-capacity Transformer model, we effectively decouple the complexity of the large task space from the complexity of individual tasks. Our method is particularly effective for small target CNN architectures where learning a fixed universal task-independent embedding is not optimal and better performance is attained when the information about the task can modulate all model parameters. For larger models we discover that generating the last layer alone allows us to produce competitive or better results than those obtained with state-of-the-art methods while being end-to-end differentiable.
Code (2)
Tasks
Few-Shot Image ClassificationFew-Shot LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HyperTransformer: Attention-Based CNN Model Generation from Few Samples
In this work we propose a HyperTransformer, a transformer based model that generates all weights of a CNN model directly from the support samples. This approach allows to use a high-capacity model for encoding task-depen…
Few-Shot LearningContinual HyperTransformer: A Meta-Learner for Continual Few-Shot Learning
We focus on the problem of learning without forgetting from multiple tasks arriving sequentially, where each task is defined using a few-shot episode of novel or already seen classes. We approach this problem using the r…
class-incremental learningClass Incremental Learningcontinual few-shot learningContinual Learning+2StrokeGAN+: Few-Shot Semi-Supervised Chinese Font Generation with Stroke Encoding
The generation of Chinese fonts has a wide range of applications. The currently predominated methods are mainly based on deep generative models, especially the generative adversarial networks (GANs). However, existing GA…
Font GenerationHyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening
Pansharpening aims to fuse a registered high-resolution panchromatic image (PAN) with a low-resolution hyperspectral image (LR-HSI) to generate an enhanced HSI with high spectral and spatial resolution. Existing pansharp…
PansharpeningSuper-ResolutionEmpirical Perspectives on One-Shot Semi-supervised Learning
One of the greatest obstacles in the adoption of deep neural networks for new applications is that training the network typically requires a large number of manually labeled training samples. We empirically investigate t…
image-classificationImage Classification