paper-with-me

Papers

Building a visual semantics aware object hierarchy

2022-02-26 · Xiaolei Diao

The semantic gap is defined as the difference between the linguistic representations of the same concept, which usually leads to misunderstanding between individuals with different knowledge backgrounds. Since linguistically annotated images are extensively used for training machine learning models, semantic gap problem (SGP) also results in inevitable bias on image annotations and further leads to poor performance on current computer vision tasks. To address this problem, we propose a novel unsupervised method to build visual semantics aware object hierarchy, aiming to get a classification model by learning from pure-visual information and to dissipate the bias of linguistic representations caused by SGP. Our intuition in this paper comes from real-world knowledge representation where concepts are hierarchically organized, and each concept can be described by a set of features rather than a linguistic annotation, namely visual semantic. The evaluation consists of two parts, firstly we apply the constructed hierarchy on the object recognition task and then we compare our visual hierarchy and existing lexical hierarchies to show the validity of our method. The preliminary results reveal the efficiency and potential of our proposed method.

📄 PDF Abstract BibTeX arXiv:2202.13021

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectObject RecognitionWorld Knowledge

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Learning Procedural-aware Video Representations through State-Grounded Hierarchy Unfolding

2025-11-25 · Jinghan Zhao, Yifei Huang, Feng Lu arxiv

Learning procedural-aware video representations is a key step towards building agents that can reason about and execute complex tasks. Existing methods typically address this problem by aligning visual content with textu…

Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification

2021-08-01 · ACL 2021 5 · Haibin Chen, Qianli Ma, Zhenxi Lin, Jiangyue Yan

Hierarchical text classification is an important yet challenging task due to the complex structure of the label hierarchy. Existing methods ignore the semantic relationship between text and labels, so they cannot make fu…

Classificationtext-classificationText Classification

Instance-aware Remote Sensing Image Captioning with Cross-hierarchy Attention

2021-05-11 · Chengze Wang, Zhiyu Jiang, Yuan Yuan

The spatial attention is a straightforward approach to enhance the performance for remote sensing image captioning. However, conventional spatial attention approaches consider only the attention distribution on one fixed…

DecoderDiversityImage Captioning

HiCLIP: Contrastive Language-Image Pretraining with Hierarchy-aware Attention

2023-03-06 · Shijie Geng, Jianbo Yuan, Yu Tian, Yuxiao Chen 외

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency a…

cross-modal alignment

Towards Visual Semantics

2021-04-26 · Fausto Giunchiglia, Luca Erculiani, Andrea Passerini

Lexical Semantics is concerned with how words encode mental representations of the world, i.e., concepts . We call this type of concepts, classification concepts . In this paper, we focus on Visual Semantics , namely on …

General Classification