paper-with-me

Papers

COMAE: COMprehensive Attribute Exploration for Zero-shot Hashing

2024-02-26 · Yuqi Li, Qingqing Long, Yihang Zhou, Ran Zhang, Zhiyuan Ning, Zhihong Zhu, Yuanchun Zhou, Xuezhi Wang, Meng Xiao

Zero-shot hashing (ZSH) has shown excellent success owing to its efficiency and generalization in large-scale retrieval scenarios. While considerable success has been achieved, there still exist urgent limitations. Existing works ignore the locality relationships of representations and attributes, which have effective transferability between seeable classes and unseeable classes. Also, the continuous-value attributes are not fully harnessed. In response, we conduct a COMprehensive Attribute Exploration for ZSH, named COMAE, which depicts the relationships from seen classes to unseen ones through three meticulously designed explorations, i.e., point-wise, pair-wise and class-wise consistency constraints. By regressing attributes from the proposed attribute prototype network, COMAE learns the local features that are relevant to the visual attributes. Then COMAE utilizes contrastive learning to comprehensively depict the context of attributes, rather than instance-independent optimization. Finally, the class-wise constraint is designed to cohesively learn the hash code, image representation, and visual attributes more effectively. Experimental results on the popular ZSH datasets demonstrate that COMAE outperforms state-of-the-art hashing techniques, especially in scenarios with a larger number of unseen label classes.

📄 PDF Abstract BibTeX arXiv:2402.16424

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeContrastive LearningRetrieval

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets

2023-02-13 · Jiange Yang, Sheng Guo, Gangshan Wu, LiMin Wang

Current RGB-D scene recognition approaches often train two standalone backbones for RGB and depth modalities with the same Places or ImageNet pre-training. However, the pre-trained depth network is still biased by RGB-ba…

Contrastive LearningRepresentation LearningScene Recognition

CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generation

2021-05-18 · Findings (ACL) 2021 8 · Chujie Zheng, Yong liu, Wei Chen, Yongcai Leng 외

The capacity of empathy is crucial to the success of open-domain dialog systems. Due to its nature of multi-dimensionality, there are various factors that relate to empathy expression, such as communication mechanism, di…

Empathetic Response GenerationOpen-Domain DialogResponse Generation

Towards Zero-shot Sign Language Recognition

2022-01-15 · Yunus Can Bilge, Ramazan Gokberk Cinbis, Nazli Ikizler-Cinbis

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, r…

AttributeDescriptiveSign Language RecognitionTransfer Learning+1

RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation

2023-05-26 · Gabriele Sarti, Phu Mon Htut, Xing Niu, Benjamin Hsu 외

Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of translation outputs. While ACT has garnered attention…

AttributeMachine TranslationRetrievalSemantic Similarity+2

Attribute Localization and Revision Network for Zero-Shot Learning

2023-10-11 · Junzhe Xu, Suling Duan, Chenwei Tang, Zhenan He 외

Zero-shot learning enables the model to recognize unseen categories with the aid of auxiliary semantic information such as attributes. Current works proposed to detect attributes from local image regions and align extrac…

AttributeZero-Shot Learning