paper-with-me

홈 › Papers

Few Shot Learning with Simplex

2018-07-27 · Bowen Zhang, Xifan Zhang, Fan Cheng, Deli Zhao

Deep learning has made remarkable achievement in many fields. However, learning the parameters of neural networks usually demands a large amount of labeled data. The algorithms of deep learning, therefore, encounter difficulties when applied to supervised learning where only little data are available. This specific task is called few-shot learning. To address it, we propose a novel algorithm for few-shot learning using discrete geometry, in the sense that the samples in a class are modeled as a reduced simplex. The volume of the simplex is used for the measurement of class scatter. During testing, combined with the test sample and the points in the class, a new simplex is formed. Then the similarity between the test sample and the class can be quantized with the ratio of volumes of the new simplex to the original class simplex. Moreover, we present an approach to constructing simplices using local regions of feature maps yielded by convolutional neural networks. Experiments on Omniglot and miniImageNet verify the effectiveness of our simplex algorithm on few-shot learning.

📄 PDF Abstract BibTeX arXiv:1807.10726

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Learning

Similar Papers 제목 키워드 기반

K-shot NAS: Learnable Weight-Sharing for NAS with K-shot Supernets

2021-06-11 · Xiu Su, Shan You, Mingkai Zheng, Fei Wang 외

In one-shot weight sharing for NAS, the weights of each operation (at each layer) are supposed to be identical for all architectures (paths) in the supernet. However, this rules out the possibility of adjusting operation…

Disambiguation of One-Shot Visual Classification Tasks: A Simplex-Based Approach

2023-01-16 · Yassir Bendou, Lucas Drumetz, Vincent Gripon, Giulia Lioi 외

The field of visual few-shot classification aims at transferring the state-of-the-art performance of deep learning visual systems onto tasks where only a very limited number of training samples are available. The main so…

MASIL: Towards Maximum Separable Class Representation for Few Shot Class Incremental Learning

2023-04-08 · Anant Khandelwal

Few Shot Class Incremental Learning (FSCIL) with few examples per class for each incremental session is the realistic setting of continual learning since obtaining large number of annotated samples is not feasible and co…

class-incremental learningClass Incremental LearningContinual LearningFew-Shot Class-Incremental Learning+1

Improving generalization in large language models by learning prefix subspaces

2023-10-24 · Louis Falissard, Vincent Guigue, Laure Soulier

This article focuses on large language models (LLMs) fine-tuning in the scarce data regime (also known as the "few-shot" learning setting). We propose a method to increase the generalization capabilities of LLMs based on…

Few-Shot Learningparameter-efficient fine-tuning

SIMPLEX-PB 2.0: A Reliable Dataset for Lexical Simplification in Brazilian Portuguese

2020-07-01 · WS 2020 7 · Nathan Hartmann, Gustavo Henrique Paetzold, S Alu{\'\i}sio, ra

Most research on Lexical Simplification (LS) addresses non-native speakers of English, since they are numerous and easy to recruit. This makes it difficult to create LS solutions for other languages and target audiences.…

Lexical Simplification