Visual Relationship Detection with Language prior and Softmax
Visual relationship detection is an intermediate image understanding task that detects two objects and classifies a predicate that explains the relationship between two objects in an image. The three components are linguistically and visually correlated (e.g. "wear" is related to "person" and "shirt", while "laptop" is related to "table" and "on") thus, the solution space is huge because there are many possible cases between them. Language and visual modules are exploited and a sophisticated spatial vector is proposed. The models in this work outperformed the state of arts without costly linguistic knowledge distillation from a large text corpus and building complex loss functions. All experiments were only evaluated on Visual Relationship Detection and Visual Genome dataset.
Code (1)
Tasks
Knowledge DistillationRelationship DetectionVisual Relationship DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Introduction to the 1st Place Winning Model of OpenImages Relationship Detection Challenge
This article describes the model we built that achieved 1st place in the OpenImage Visual Relationship Detection Challenge on Kaggle. Three key factors contribute the most to our success: 1) language bias is a powerful b…
Relationship DetectionVisual Relationship DetectionVisual Relationship Detection with Language Priors
Visual relationships capture a wide variety of interactions between pairs of objects in images (e.g. "man riding bicycle" and "man pushing bicycle"). Consequently, the set of possible relationships is extremely large and…
Content-Based Image RetrievalImage RetrievalRelationship DetectionRetrieval+2Context-Dependent Diffusion Network for Visual Relationship Detection
Visual relationship detection can bridge the gap between computer vision and natural language for scene understanding of images. Different from pure object recognition tasks, the relation triplets of subject-predicate-ob…
DiversityObjectObject RecognitionRelationship Detection+2Investigation of Large-Margin Softmax in Neural Language Modeling
To encourage intra-class compactness and inter-class separability among trainable feature vectors, large-margin softmax methods are developed and widely applied in the face recognition community. The introduction of the …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Face RecognitionLanguage Modeling+3AVR: Attention based Salient Visual Relationship Detection
Visual relationship detection aims to locate objects in images and recognize the relationships between objects. Traditional methods treat all observed relationships in an image equally, which causes a relatively poor per…
Relationship DetectionVisual Relationship Detection