paper-with-me

홈 › Papers

Scenes and Surroundings: Scene Graph Generation using Relation Transformer

2021-07-12 · Rajat Koner, Poulami Sinhamahapatra, Volker Tresp

Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships remain a challenging task. This work proposes a novel local-context aware architecture named relation transformer, which exploits complex global objects to object and object to edge (relation) interactions. Our hierarchical multi-head attention-based approach efficiently captures contextual dependencies between objects and predicts their relationships. In comparison to state-of-the-art approaches, we have achieved an overall mean \textbf{4.85\%} improvement and a new benchmark across all the scene graph generation tasks on the Visual Genome dataset.

📄 PDF Abstract BibTeX arXiv:2107.05448

Code (1)

rajatkoner08/Graphhopper pytorch

Tasks

Graph GenerationObjectRelationScene Graph Generation

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences

2026-02-03 · Seok-Young Kim, Dooyoung Kim, Woojin Cho, Hail Song 외 arxiv

We introduce SceneLinker, a novel framework that generates compositional 3D scenes via semantic scene graph from RGB sequences. To adaptively experience Mixed Reality (MR) content based on each user's space, it is essent…

Scene Generation

Unconditional Scene Graph Generation

2021-08-12 · ICCV 2021 10 · Sarthak Garg, Helisa Dhamo, Azade Farshad, Sabrina Musatian 외

Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of no…

Anomaly DetectionGraph GenerationImage GenerationObject+1

CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion

2023-05-25 · NeurIPS 2023 11 · Guangyao Zhai, Evin Pınar Örnek, Shun-Cheng Wu, Yan Di 외

Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in…

DiversityObjectScene Generation

HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation

2024-11-27 · CVPR 2025 1 · Trong-Thuan Nguyen, Pha Nguyen, Jackson Cothren, Alper Yilmaz 외

Multimodal LLMs have advanced vision-language tasks but still struggle with understanding video scenes. To bridge this gap, Video Scene Graph Generation (VidSGG) has emerged to capture multi-object relationships across v…

Graph GenerationQuestion AnsweringScene Graph GenerationVideo Captioning+2

3D Scene Diffusion Guidance using Scene Graphs

2023-08-08 · Mohammad Naanaa, Katharina Schmid, Yinyu Nie

Guided synthesis of high-quality 3D scenes is a challenging task. Diffusion models have shown promise in generating diverse data, including 3D scenes. However, current methods rely directly on text embeddings for control…

Denoising