paper-with-me

Papers

Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition

2018-07-24 · ECCV 2018 9 · Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on learning visual-semantic embeddings to transfer knowledge from the auxiliary datasets to the novel classes. However, few works study whether the semantic information is discriminative or not for the recognition task. To tackle such problem, we propose a coupled dictionary learning approach to align the visual-semantic structures using the class prototypes, where the discriminative information lying in the visual space is utilized to improve the less discriminative semantic space. Then, zero-shot recognition can be performed in different spaces by the simple nearest neighbor approach using the learned class prototypes. Extensive experiments on four benchmark datasets show the effectiveness of the proposed approach.

📄 PDF Abstract BibTeX arXiv:1807.09123

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary LearningZero-Shot Learning

Similar Papers 제목 키워드 기반

Supervised Classification Heads as Semantic Prototypes: Unlocking Vision-Language Alignment via Weight Recycling

2026-05-21 · David Méndez, Roberto Confalonieri, Natalia Díaz Rodríguez arxiv

Vision-Language Models (VLMs) excel at tasks like zero-shot classification and cross-modal retrieval by mapping images and text to a shared space, but this requires expensive end-to-end training with massive paired datas…

Cross-Modal RetrievalData Augmentation

Learning Prototype via Placeholder for Zero-shot Recognition

2022-07-29 · Zaiquan Yang, Yang Liu, Wenjia Xu, Chong Huang 외

Zero-shot learning (ZSL) aims to recognize unseen classes by exploiting semantic descriptions shared between seen classes and unseen classes. Current methods show that it is effective to learn visual-semantic alignment b…

Zero-Shot Learning

DPA: Dual Prototypes Alignment for Unsupervised Adaptation of Vision-Language Models

2024-08-16 · Eman Ali, Sathira Silva, Muhammad Haris Khan

Vision-language models (VLMs), e.g., CLIP, have shown remarkable potential in zero-shot image classification. However, adapting these models to new domains remains challenging, especially in unsupervised settings where l…

Domain Adaptationimage-classificationImage ClassificationPseudo Label+2

Evolving Semantic Prototype Improves Generative Zero-Shot Learning

2023-06-12 · Shiming Chen, Wenjin Hou, Ziming Hong, Xiaohan Ding 외

In zero-shot learning (ZSL), generative methods synthesize class-related sample features based on predefined semantic prototypes. They advance the ZSL performance by synthesizing unseen class sample features for better t…

Zero-Shot Learning

AlignZeg: Mitigating Objective Misalignment for Zero-shot Semantic Segmentation

2024-04-08 · Jiannan Ge, Lingxi Xie, Hongtao Xie, Pandeng Li 외

A serious issue that harms the performance of zero-shot visual recognition is named objective misalignment, i.e., the learning objective prioritizes improving the recognition accuracy of seen classes rather than unseen c…

Image SegmentationSegmentationSemantic SegmentationZero Shot Segmentation+1