Geometric Mean Improves Loss For Few-Shot Learning

2025-01-24 · Tong Wu, Takumi Kobayashi

Few-shot learning (FSL) is a challenging task in machine learning, demanding a model to render discriminative classification by using only a few labeled samples. In the literature of FSL, deep models are trained in a manner of metric learning to provide metric in a feature space which is well generalizable to classify samples of novel classes; in the space, even a few amount of labeled training examples can construct an effective classifier. In this paper, we propose a novel FSL loss based on \emph{geometric mean} to embed discriminative metric into deep features. In contrast to the other losses such as utilizing arithmetic mean in softmax-based formulation, the proposed method leverages geometric mean to aggregate pair-wise relationships among samples for enhancing discriminative metric across class categories. The proposed loss is not only formulated in a simple form but also is thoroughly analyzed in theoretical ways to reveal its favorable characteristics which are favorable for learning feature metric in FSL. In the experiments on few-shot image classification tasks, the method produces competitive performance in comparison to the other losses.

📄 PDF Abstract BibTeX arXiv:2501.14593

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Image Classification Few-Shot Learning image-classification Image Classification Metric Learning

Methods 이 논문이 사용한 방법론

Bitcoin Customer Service Number +1-833-534-1729 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation

2026-03-27 · Jesse Barkley, Rumi Loghmani, Amir Barati Farimani arxiv

Existing methods for text-to-CAD generation either operate in a single pass with no geometric verification or rely on lossy visual feedback that cannot resolve dimensional errors. We present CADSmith, a multi-agent pipel…

Zero-shot point cloud segmentation by transferring geometric primitives

2022-10-18 · Runnan Chen, Xinge Zhu, Nenglun Chen, Wei Li 외

We investigate transductive zero-shot point cloud semantic segmentation, where the network is trained on seen objects and able to segment unseen objects. The 3D geometric elements are essential cues to imply a novel 3D o…

Point Cloud Segmentation Semantic Segmentation

MOONSHOT : A Framework for Multi-Objective Pruning of Vision and Large Language Models

2026-04-14 · Gabriel Afriat, Xiang Meng, Shibal Ibrahim, Hussein Hazimeh 외 arxiv

Weight pruning is a common technique for compressing large neural networks. We focus on the challenging post-training one-shot setting, where a pre-trained model is compressed without any retraining. Existing one-shot pr…

VIABLE: Fast Adaptation via Backpropagating Learned Loss

2019-11-29 · Leo Feng, Luisa Zintgraf, Bei Peng, Shimon Whiteson

In few-shot learning, typically, the loss function which is applied at test time is the one we are ultimately interested in minimising, such as the mean-squared-error loss for a regression problem. However, given that we…

Few-Shot Learning Meta-Learning regression

Difference Vector Equalization for Robust Fine-tuning of Vision-Language Models

2025-11-13 · Satoshi Suzuki, Shin'ya Yamaguchi, Shoichiro Takeda, Taiga Yamane 외 arxiv

Contrastive pre-trained vision-language models, such as CLIP, demonstrate strong generalization abilities in zero-shot classification by leveraging embeddings extracted from image and text encoders. This paper aims to ro…

Contrastive Learning