Hierarchical Graph Attention Network for Visual Relationship Detection
Visual Relationship Detection (VRD) aims to describe the relationship between two objects by providing a structural triplet shown as . Existing graph-based methods mainly represent the relationships by an object-level graph, which ignores to model the triplet-level dependencies. In this work, a Hierarchical Graph Attention Network (HGAT) is proposed to capture the dependencies on both object-level and triplet-level. Object-level graph aims to capture the interactions between objects, while the triplet-level graph models the dependencies among relation triplets. In addition, prior knowledge and attention mechanism are introduced to fix the redundant or missing edges on graphs that are constructed according to spatial correlation. With these approaches, nodes are allowed to attend over their spatial and semantic neighborhoods' features based on the visual or semantic feature correlation. Experimental results on the well-known VG and VRD datasets demonstrate that our model significantly outperforms the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature CorrelationGraph AttentionObjectRelationship DetectionTripletVisual Relationship DetectionSimilar Papers 제목 키워드 기반
Scenes and Surroundings: Scene Graph Generation using Relation Transformer
Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object…
Graph GenerationObjectRelationScene Graph GenerationTopology Imbalance and Relation Inauthenticity Aware Hierarchical Graph Attention Networks for Fake News Detection
Fake news detection is a challenging problem due to its tremendous real-world political and social impacts. Recent fake news detection works focus on learning news features from News Propagation Graph (NPG). However, lit…
Fake News DetectionGraph AttentionRelationHR-RCNN: Hierarchical Relational Reasoning for Object Detection
Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relation…
Graph AttentionInstance SegmentationObjectobject-detection+4Hierarchical Graph Attention Network for Few-Shot Visual-Semantic Learning
Deep learning has made tremendous success in computer vision, natural language processing and even visual-semantic learning, which requires a huge amount of labeled training data. Nevertheless, the goal of human-leve…
Graph AttentionImage CaptioningQuestion AnsweringVisual Question Answering+1AVR: Attention based Salient Visual Relationship Detection
Visual relationship detection aims to locate objects in images and recognize the relationships between objects. Traditional methods treat all observed relationships in an image equally, which causes a relatively poor per…
Relationship DetectionVisual Relationship Detection