paper-with-me

홈 › Papers

Visual Relationship Detection using Scene Graphs: A Survey

2020-05-16 · Aniket Agarwal, Ayush Mangal, Vipul

Understanding a scene by decoding the visual relationships depicted in an image has been a long studied problem. While the recent advances in deep learning and the usage of deep neural networks have achieved near human accuracy on many tasks, there still exists a pretty big gap between human and machine level performance when it comes to various visual relationship detection tasks. Developing on earlier tasks like object recognition, segmentation and captioning which focused on a relatively coarser image understanding, newer tasks have been introduced recently to deal with a finer level of image understanding. A Scene Graph is one such technique to better represent a scene and the various relationships present in it. With its wide number of applications in various tasks like Visual Question Answering, Semantic Image Retrieval, Image Generation, among many others, it has proved to be a useful tool for deeper and better visual relationship understanding. In this paper, we present a detailed survey on the various techniques for scene graph generation, their efficacy to represent visual relationships and how it has been used to solve various downstream tasks. We also attempt to analyze the various future directions in which the field might advance in the future. Being one of the first papers to give a detailed survey on this topic, we also hope to give a succinct introduction to scene graphs, and guide practitioners while developing approaches for their applications.

📄 PDF Abstract BibTeX arXiv:2005.08045

Code (0)

등록된 구현이 없습니다.

Tasks

Graph GenerationImage GenerationImage RetrievalObject RecognitionQuestion AnsweringRelationship DetectionRetrievalScene Graph GenerationSurveyVisual Question AnsweringVisual Question Answering (VQA)Visual Relationship Detection

Similar Papers 제목 키워드 기반

A Comprehensive Survey of Scene Graphs: Generation and Application

2021-03-17 · Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li 외

Scene graph is a structured representation of a scene that can clearly express the objects, attributes, and relationships between objects in the scene. As computer vision technology continues to develop, people are no lo…

Image CaptioningQuestion AnsweringRelationship DetectionRetrieval+5

Context-Dependent Diffusion Network for Visual Relationship Detection

2018-09-11 · Zhen Cui, Chunyan Xu, Wenming Zheng, Jian Yang

Visual relationship detection can bridge the gap between computer vision and natural language for scene understanding of images. Different from pure object recognition tasks, the relation triplets of subject-predicate-ob…

DiversityObjectObject RecognitionRelationship Detection+2

NeuSyRE: Neuro-Symbolic Visual Understanding and Reasoning Framework based on Scene Graph Enrichment

2023-11-05 · Semantic Web 2023 11 · M. Jaleed Khan, John Breslin, Edward Curry

Neuro-symbolic hybrid approaches are inevitable for seamless high-level understanding and reasoning about visual scenes. Scene Graph Generation (SGG) is a symbolic image representation approach based on deep neural netwo…

Caption GenerationCommon Sense ReasoningGraph GenerationImage Captioning+7

Scene Graph Generation: A Comprehensive Survey

2022-01-03 · Guangming Zhu, Liang Zhang, Youliang Jiang, Yixuan Dang 외

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research becau…

Graph Generationobject-detectionObject DetectionRelationship Detection+4

Adaptive Visual Scene Understanding: Incremental Scene Graph Generation

2023-10-02 · Naitik Khandelwal, Xiao Liu, Mengmi Zhang

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and estab…

BenchmarkingContinual LearningGraph Generationobject-detection+3