Scenes and Surroundings: Scene Graph Generation using Relation Transformer
Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships remain a challenging task. This work proposes a novel local-context aware architecture named relation transformer, which exploits complex global objects to object and object to edge (relation) interactions. Our hierarchical multi-head attention-based approach efficiently captures contextual dependencies between objects and predicts their relationships. In comparison to state-of-the-art approaches, we have achieved an overall mean \textbf{4.85\%} improvement and a new benchmark across all the scene graph generation tasks on the Visual Genome dataset.
Code (1)
Tasks
Graph GenerationObjectRelationScene Graph GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences
We introduce SceneLinker, a novel framework that generates compositional 3D scenes via semantic scene graph from RGB sequences. To adaptively experience Mixed Reality (MR) content based on each user's space, it is essent…
Scene GenerationUnconditional Scene Graph Generation
Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of no…
Anomaly DetectionGraph GenerationImage GenerationObject+1CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion
Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in…
DiversityObjectScene GenerationHyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation
Multimodal LLMs have advanced vision-language tasks but still struggle with understanding video scenes. To bridge this gap, Video Scene Graph Generation (VidSGG) has emerged to capture multi-object relationships across v…
Graph GenerationQuestion AnsweringScene Graph GenerationVideo Captioning+23D Scene Diffusion Guidance using Scene Graphs
Guided synthesis of high-quality 3D scenes is a challenging task. Diffusion models have shown promise in generating diverse data, including 3D scenes. However, current methods rely directly on text embeddings for control…
Denoising