paper-with-me

홈 › Papers

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

2023-02-09 · Zhaonan Li, Hongfu Liu

Generalized Zero-Shot Learning (GZSL) and Open-Set Recognition (OSR) are two mainstream settings that greatly extend conventional visual object recognition. However, the limitations of their problem settings are not negligible. The novel categories in GZSL require pre-defined semantic labels, making the problem setting less realistic; the oversimplified unknown class in OSR fails to explore the innate fine-grained and mixed structures of novel categories. In light of this, we are motivated to consider a new problem setting named Zero-Knowledge Zero-Shot Learning (ZK-ZSL) that assumes no prior knowledge of novel classes and aims to classify seen and unseen samples and recover semantic attributes of the fine-grained novel categories for further interpretation. To achieve this, we propose a novel framework that recovers the clustering structures of both seen and unseen categories where the seen class structures are guided by source labels. In addition, a structural alignment loss is designed to aid the semantic learning of unseen categories with their recovered structures. Experimental results demonstrate our method's superior performance in classification and semantic recovery on four benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2302.04427

Code (0)

등록된 구현이 없습니다.

Tasks

Generalized Zero-Shot LearningObject RecognitionOpen Set LearningZero-Shot Learning

Similar Papers 제목 키워드 기반

Zero-shot Recognition via Semantic Embeddings and Knowledge Graphs

2018-03-21 · CVPR 2018 6 · Xiaolong Wang, Yufei Ye, Abhinav Gupta

We consider the problem of zero-shot recognition: learning a visual classifier for a category with zero training examples, just using the word embedding of the category and its relationship to other categories, which vis…

Graph Neural NetworkKnowledge GraphsZero-Shot Learning

Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview

2022-11-13 · Wenqi Ren, Yang Tang, Qiyu Sun, Chaoqiang Zhao 외

Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block, and it plays a crucial role in environmental perception. …

SegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation+1

Language Models as Zero-shot Visual Semantic Learners

2021-07-26 · Yue Jiao, Jonathon Hare, Adam Prügel-Bennett

Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-…

ObjectObject RecognitionWord EmbeddingsZero-Shot Learning

Meta-Prompting for Automating Zero-shot Visual Recognition with LLMs

2024-03-18 · M. Jehanzeb Mirza, Leonid Karlinsky, Wei Lin, Sivan Doveh 외

Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs). To obtain these category-s…

Language ModellingLarge Language ModelZero-Shot Learning

Class Knowledge Overlay to Visual Feature Learning for Zero-Shot Image Classification

2021-02-26 · Cheng Xie, Ting Zeng, Hongxin Xiang, Keqin Li 외

New categories can be discovered by transforming semantic features into synthesized visual features without corresponding training samples in zero-shot image classification. Although significant progress has been made in…

General Classificationimage-classificationImage ClassificationTriplet+2