paper-with-me

홈 › Papers

Dual Expert Distillation Network for Generalized Zero-Shot Learning

2024-04-25 · Zhijie Rao, Jingcai Guo, Xiaocheng Lu, Jingming Liang, Jie Zhang, Haozhao Wang, Kang Wei, Xiaofeng Cao

Zero-shot learning has consistently yielded remarkable progress via modeling nuanced one-to-one visual-attribute correlation. Existing studies resort to refining a uniform mapping function to align and correlate the sample regions and subattributes, ignoring two crucial issues: 1) the inherent asymmetry of attributes; and 2) the unutilized channel information. This paper addresses these issues by introducing a simple yet effective approach, dubbed Dual Expert Distillation Network (DEDN), where two experts are dedicated to coarse- and fine-grained visual-attribute modeling, respectively. Concretely, one coarse expert, namely cExp, has a complete perceptual scope to coordinate visual-attribute similarity metrics across dimensions, and moreover, another fine expert, namely fExp, consists of multiple specialized subnetworks, each corresponds to an exclusive set of attributes. Two experts cooperatively distill from each other to reach a mutual agreement during training. Meanwhile, we further equip DEDN with a newly designed backbone network, i.e., Dual Attention Network (DAN), which incorporates both region and channel attention information to fully exploit and leverage visual semantic knowledge. Experiments on various benchmark datasets indicate a new state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2404.16348

Code (1)

zjrao/dedn 공식 구현 pytorch

Tasks

AttributeGeneralized Zero-Shot LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition

2024-02-18 · Yijie Wang, Mingjian Hong, Luwen Huangfu, Sheng Huang

In the realm of Zero-Shot Learning (ZSL), we address biases in Generalized Zero-Shot Learning (GZSL) models, which favor seen data. To counter this, we introduce an end-to-end generative GZSL framework called D$^3$GZSL. …

Generalized Zero-Shot LearningZero-Shot Learning

GZSL-MoE: Apprentissage G{é}n{é}ralis{é} Z{é}ro-Shot bas{é} sur le M{é}lange d'Experts pour la Segmentation S{é}mantique de Nuages de Points 3DAppliqu{é} {à} un Jeu de Donn{é}es d'Environnement de Collaboration Humain-Robot

2025-09-23 · Ahed Alboody arxiv

Generative Zero-Shot Learning approach (GZSL) has demonstrated significant potential in 3D point cloud semantic segmentation tasks. GZSL leverages generative models like GANs or VAEs to synthesize realistic features (rea…

Generalized Zero-Shot Learning3D Semantic Segmentation

Point Segment and Count: A Generalized Framework for Object Counting

2024-01-01 · CVPR 2024 1 · Zhizhong Huang, Mingliang Dai, Yi Zhang, Junping Zhang 외

Class-agnostic object counting aims to count all objects in an image with respect to example boxes or class names a.k.a few-shot and zero-shot counting. In this paper we propose a generalized framework for both few-s…

Few-shot Object Counting and DetectionKnowledge DistillationObjectObject Counting+2

A Generalized Zero-Shot Quantization of Deep Convolutional Neural Networks via Learned Weights Statistics

2021-12-06 · Prasen Kumar Sharma, Arun Abraham, Vikram Nelvoy Rajendiran

Quantizing the floating-point weights and activations of deep convolutional neural networks to fixed-point representation yields reduced memory footprints and inference time. Recently, efforts have been afoot towards zer…

Quantization

Point, Segment and Count: A Generalized Framework for Object Counting

2023-11-21 · Zhizhong Huang, Mingliang Dai, Yi Zhang, Junping Zhang 외

Class-agnostic object counting aims to count all objects in an image with respect to example boxes or class names, \emph{a.k.a} few-shot and zero-shot counting. In this paper, we propose a generalized framework for both …

Knowledge DistillationObjectObject CountingObject Localization+1