paper-with-me

홈 › Papers

SuSana Distancia is all you need: Enforcing class separability in metric learning via two novel distance-based loss functions for few-shot image classification

2023-05-15 · Mauricio Mendez-Ruiz, Jorge Gonzalez-Zapata, Ivan Reyes-Amezcua, Daniel Flores-Araiza, Francisco Lopez-Tiro, Andres Mendez-Vazquez, Gilberto Ochoa-Ruiz

Few-shot learning is a challenging area of research that aims to learn new concepts with only a few labeled samples of data. Recent works based on metric-learning approaches leverage the meta-learning approach, which is encompassed by episodic tasks that make use a support (training) and query set (test) with the objective of learning a similarity comparison metric between those sets. Due to the lack of data, the learning process of the embedding network becomes an important part of the few-shot task. Previous works have addressed this problem using metric learning approaches, but the properties of the underlying latent space and the separability of the difference classes on it was not entirely enforced. In this work, we propose two different loss functions which consider the importance of the embedding vectors by looking at the intra-class and inter-class distance between the few data. The first loss function is the Proto-Triplet Loss, which is based on the original triplet loss with the modifications needed to better work on few-shot scenarios. The second loss function, which we dub ICNN loss is based on an inter and intra class nearest neighbors score, which help us to assess the quality of embeddings obtained from the trained network. Our results, obtained from a extensive experimental setup show a significant improvement in accuracy in the miniImagenNet benchmark compared to other metric-based few-shot learning methods by a margin of 2%, demonstrating the capability of these loss functions to allow the network to generalize better to previously unseen classes. In our experiments, we demonstrate competitive generalization capabilities to other domains, such as the Caltech CUB, Dogs and Cars datasets compared with the state of the art.

📄 PDF Abstract BibTeX arXiv:2305.09062

Code (0)

등록된 구현이 없습니다.

Tasks

AllFew-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationMeta-LearningMetric LearningTriplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models

2026-05-25 · Yiwei Xie, Ping Liu, Zheng Zhang arxiv

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignm…

Pretraining Objective Matters in Extreme Low-Data FGVC: A Backbone-Controlled Study

2026-05-15 · Alexander Hackett, Srikanth Thudumu, Ginny Fisher, Jason Fisher arxiv

Extreme low-data fine-grained classification is common in expert domains where labeling is expensive, yet practitioners still need principled guidance for selecting pretrained encoders. We study emerald inclusion grading…

Contrastive Learning

Quality Adaptive Angular Margin Learning for Respiratory Sound Classification

2026-06-10 · Yoon Tae Kim, Heejoon Koo, Miika Toikkanen, June-Woo Kim arxiv

We present a quality-adaptive angular-margin learning framework that improves feature generalization by enforcing intra-class compactness and inter-class separability. Our framework, titled QLung, introduces a no-referen…

Preserving Linear Separability in Continual Learning by Backward Feature Projection

2023-03-26 · CVPR 2023 1 · Qiao Gu, Dongsub Shim, Florian Shkurti

Catastrophic forgetting has been a major challenge in continual learning, where the model needs to learn new tasks with limited or no access to data from previously seen tasks. To tackle this challenge, methods based on …

Continual LearningKnowledge Distillation

Generalized Zero-Shot Learning Via Over-Complete Distribution

2020-04-01 · CVPR 2020 6 · Rohit Keshari, Richa Singh, Mayank Vatsa

A well trained and generalized deep neural network (DNN) should be robust to both seen and unseen classes. However, the performance of most of the existing supervised DNN algorithms degrade for classes which are unseen i…

Generalized Zero-Shot LearningTripletZero-Shot Learning