paper-with-me

홈 › Papers

Collect and Select: Semantic Alignment Metric Learning for Few-Shot Learning

2019-10-01 · ICCV 2019 10 · Fusheng Hao, Fengxiang He, Jun Cheng, Lei Wang, Jianzhong Cao, Dacheng Tao

Few-shot learning aims to learn latent patterns from few training examples and has shown promises in practice. However, directly calculating the distances between the query image and support image in existing methods may cause ambiguity because dominant objects can locate anywhere on images. To address this issue, this paper proposes a Semantic Alignment Metric Learning (SAML) method for few-shot learning that aligns the semantically relevant dominant objects through a "collect-and-select" strategy. Specifically, we first calculate a relation matrix (RM) to "collect" the distances of each local region pairs of the 3D tensor extracted from a query image and the mean tensor of the support images. Then, the attention technique is adapted to "select" the semantically relevant pairs and put more weights on them. Afterwards, a multi-layer perceptron (MLP) is utilized to map the reweighted RMs to their corresponding similarity scores. Theoretical analysis demonstrates the generalization ability of SAML and gives a theoretical guarantee. Empirical results demonstrate that semantic alignment is achieved. Extensive experiments on benchmark datasets validate the strengths of the proposed approach and demonstrate that SAML significantly outperforms the current state-of-the-art methods. The source code is available at https://github.com/haofusheng/SAML.

📄 PDF Abstract BibTeX

Code (1)

haofusheng/SAML 공식 구현 pytorch

Tasks

Few-Shot LearningMetric Learning

Similar Papers 제목 키워드 기반

A$^2$M$^2$-Net: Adaptively Aligned Multi-Scale Moment for Few-Shot Action Recognition

2025-09-22 · Zilin Gao, Qilong Wang, Bingbing Zhang, Qinghua Hu 외 arxiv

Thanks to capability to alleviate the cost of large-scale annotation, few-shot action recognition (FSAR) has attracted increased attention of researchers in recent years. Existing FSAR approaches typically neglect the ro…

Action Recognition

Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

2020-09-10 · Siteng Huang, Min Zhang, Yachen Kang, Donglin Wang

The purpose of few-shot recognition is to recognize novel categories with a limited number of labeled examples in each class. To encourage learning from a supplementary view, recent approaches have introduced auxiliary s…

feature selectionMetric Learning

Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training

2023-05-22 · Jianfeng He, Julian Salazar, Kaisheng Yao, Haoqi Li 외

End-to-end (E2E) spoken language understanding (SLU) is constrained by the cost of collecting speech-semantics pairs, especially when label domains change. Hence, we explore \textit{zero-shot} E2E SLU, which learns E2E S…

Natural Language UnderstandingSpoken Language Understanding

Learning to Compare Relation: Semantic Alignment for Few-Shot Learning

2020-02-29 · Congqi Cao, Yanning Zhang

Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Di…

Few-Shot LearningMetric LearningRelation

Mitigating Hallucinations in Zero-Shot Scientific Summarisation: A Pilot Study

2025-11-30 · Imane Jaaouine, Ross D. King arxiv

Large language models (LLMs) produce context inconsistency hallucinations, which are LLM generated outputs that are misaligned with the user prompt. This research project investigates whether prompt engineering (PE) meth…

Prompt Engineering