paper-with-me

홈 › Papers

Novelty-Prepared Few-Shot Classification

2020-03-01 · Chao Wang, Ruo-Ze Liu, Han-Jia Ye, Yang Yu

Few-shot classification algorithms can alleviate the data scarceness issue, which is vital in many real-world problems, by adopting models pre-trained from abundant data in other domains. However, the pre-training process was commonly unaware of the future adaptation to other concept classes. We disclose that a classically fully trained feature extractor can leave little embedding space for unseen classes, which keeps the model from well-fitting the new classes. In this work, we propose to use a novelty-prepared loss function, called self-compacting softmax loss (SSL), for few-shot classification. The SSL can prevent the full occupancy of the embedding space. Thus the model is more prepared to learn new classes. In experiments on CUB-200-2011 and mini-ImageNet datasets, we show that SSL leads to significant improvement of the state-of-the-art performance. This work may shed some light on considering the model capacity for few-shot classification tasks.

📄 PDF Abstract BibTeX arXiv:2003.00497

Code (1)

polixir/algo-SSL pytorch

Tasks

ClassificationGeneral Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

NoveltyRank: A Retrieval-Augmented Framework for Conceptual Novelty Estimation in AI Research

2025-12-12 · Zhengxu Yan, Han Li, Yuming Feng arxiv

The accelerating pace of scientific publication makes it difficult to identify truly original research among incremental work. We propose a framework for estimating the conceptual novelty of research papers by combining …

Representation LearningBinary Classification

CLAREL: Classification via retrieval loss for zero-shot learning

2019-05-31 · Boris N. Oreshkin, Negar Rostamzadeh, Pedro O. Pinheiro, Christopher Pal

We address the problem of learning fine-grained cross-modal representations. We propose an instance-based deep metric learning approach in joint visual and textual space. The key novelty of this paper is that it shows th…

ClassificationGeneral ClassificationGeneralized Zero-Shot LearningMetric Learning+3

Self-Adaptive Label Augmentation for Semi-supervised Few-shot Classification

2022-06-16 · Xueliang Wang, Jianyu Cai, Shuiwang Ji, Houqiang Li 외

Few-shot classification aims to learn a model that can generalize well to new tasks when only a few labeled samples are available. To make use of unlabeled data that are more abundantly available in real applications, Re…

Classification

Informed Democracy: Voting-based Novelty Detection for Action Recognition

2018-10-30 · Alina Roitberg, Ziad Al-Halah, Rainer Stiefelhagen

Novelty detection is crucial for real-life applications. While it is common in activity recognition to assume a closed-set setting, i.e. test samples are always of training categories, this assumption is impractical in a…

Action ClassificationAction RecognitionActivity RecognitionNovelty Detection+2

Death of the Novel(ty): Beyond n-Gram Novelty as a Metric for Textual Creativity

2025-09-26 · Arkadiy Saakyan, Najoung Kim, Smaranda Muresan, Tuhin Chakrabarty arxiv

N-gram novelty is widely used to evaluate language models' ability to generate text outside of their training data. More recently, it has also been adopted as a metric for measuring textual creativity. However, theoretic…