paper-with-me

Papers

Learning Joint Feature Adaptation for Zero-Shot Recognition

2016-11-23 · Ziming Zhang, Venkatesh Saligrama

Zero-shot recognition (ZSR) aims to recognize target-domain data instances of unseen classes based on the models learned from associated pairs of seen-class source and target domain data. One of the key challenges in ZSR is the relative scarcity of source-domain features (e.g. one feature vector per class), which do not fully account for wide variability in target-domain instances. In this paper we propose a novel framework of learning data-dependent feature transforms for scoring similarity between an arbitrary pair of source and target data instances to account for the wide variability in target domain. Our proposed approach is based on optimizing over a parameterized family of local feature displacements that maximize the source-target adaptive similarity functions. Accordingly we propose formulating zero-shot learning (ZSL) using latent structural SVMs to learn our similarity functions from training data. As demonstration we design a specific algorithm under the proposed framework involving bilinear similarity functions and regularized least squares as penalties for feature displacement. We test our approach on several benchmark datasets for ZSR and show significant improvement over the state-of-the-art. For instance, on aP&Y dataset we can achieve 80.89% in terms of recognition accuracy, outperforming the state-of-the-art by 11.15%.

📄 PDF Abstract BibTeX arXiv:1611.07593

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-Shot Learning

Similar Papers 제목 키워드 기반

Similarity Min-Max: Zero-Shot Day-Night Domain Adaptation

2023-07-17 · ICCV 2023 1 · Rundong Luo, Wenjing Wang, Wenhan Yang, Jiaying Liu

Low-light conditions not only hamper human visual experience but also degrade the model's performance on downstream vision tasks. While existing works make remarkable progress on day-night domain adaptation, they rely he…

Action RecognitionDomain AdaptationSemantic SegmentationTemporal Action Localization+1

Leveraging LLM Embeddings for Cross Dataset Label Alignment and Zero Shot Music Emotion Prediction

2024-10-15 · Renhang Liu, Abhinaba Roy, Dorien Herremans

In this work, we present a novel method for music emotion recognition that leverages Large Language Model (LLM) embeddings for label alignment across multiple datasets and zero-shot prediction on novel categories. First,…

Emotion RecognitionLanguage ModelingLanguage ModellingLarge Language Model+1

Zero-Shot Recognition using Dual Visual-Semantic Mapping Paths

2017-03-15 · CVPR 2017 7 · Yanan Li, Donghui Wang, Huanhang Hu, Yuetan Lin 외

Zero-shot recognition aims to accurately recognize objects of unseen classes by using a shared visual-semantic mapping between the image feature space and the semantic embedding space. This mapping is learned on training…

Zero-Shot Learning

Zero-Shot Activity Recognition with Videos

2020-01-22 · Evin Pinar Ornek

In this paper, we examined the zero-shot activity recognition task with the usage of videos. We introduce an auto-encoder based model to construct a multimodal joint embedding space between the visual and textual manifol…

Action RecognitionActivity RecognitionWord EmbeddingsZero-Shot Learning

Zero-Fi: Zero-Shot Wi-Fi-Based Human Activity Recognition via Contrastive Signal-Language Alignment

2026-07-29 · Yitong Shen, Cheng Guo, Peiliang Wang, Jingzhe Zhang 외 arxiv

Wi-Fi-based human activity recognition has advanced substantially, but most existing methods assume a closed set of activities and require labeled Wi-Fi samples for every target class, limiting their ability to recognize…

Human Activity Recognition