Papers Scene Graph Generation
“Scene Graph Generation” 태그가 달린 논문 365편 · 필터 해제
Relation-aware Hierarchical Prompt for Open-vocabulary Scene Graph Generation
Open-vocabulary Scene Graph Generation (OV-SGG) overcomes the limitations of the closed-set assumption by aligning visual relationship representations with open-vocabulary textual representations. This enables the identi…
Graph GenerationLarge Language ModelRelationScene Graph Generation+1RelationField: Relate Anything in Radiance Fields
Neural radiance fields are an emerging 3D scene representation and recently even been extended to learn features for scene understanding by distilling open-vocabulary features from vision-language models. However, curren…
3d scene graph generationGraph GenerationInstance SegmentationObject+3RA-SGG: Retrieval-Augmented Scene Graph Generation Framework via Multi-Prototype Learning
Scene Graph Generation (SGG) research has suffered from two fundamental challenges: the long-tailed predicate distribution and semantic ambiguity between predicates. These challenges lead to a bias towards head predicate…
Graph GenerationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRetrieval+1SceneLLM: Implicit Language Reasoning in LLM for Dynamic Scene Graph Generation
Dynamic scenes contain intricate spatio-temporal information, crucial for mobile robots, UAVs, and autonomous driving systems to make informed decisions. Parsing these scenes into semantic triplets <Subject-Predicate-Obj…
Autonomous DrivingGraph GenerationScene Graph GenerationBenchmarking Federated Learning for Semantic Datasets: Federated Scene Graph Generation
Federated learning (FL) has recently garnered attention as a data-decentralized training framework that enables the learning of deep models from locally distributed samples while keeping data privacy. Built upon the fram…
BenchmarkingFederated LearningGraph GenerationPanoptic Scene Graph Generation+1Motion-aware Contrastive Learning for Temporal Panoptic Scene Graph Generation
To equip artificial intelligence with a comprehensive understanding towards a temporal world, video and 4D panoptic scene graph generation abstracts visual data into nodes to represent entities and edges to capture tempo…
Contrastive LearningGraph GenerationPanoptic Scene Graph GenerationRelation+2LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations
Scene Graph Generation (SGG) converts visual scenes into structured graph representations, providing deeper scene understanding for complex vision tasks. However, existing SGG models often overlook essential spatial rela…
Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model+3ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
With the rise of multimodal applications, instruction data has become critical for training multimodal language models capable of understanding complex image-based queries. Existing practices rely on powerful but costly …
Graph GenerationScene Graph GenerationVisual Question AnsweringHyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation
Multimodal LLMs have advanced vision-language tasks but still struggle with understanding video scenes. To bridge this gap, Video Scene Graph Generation (VidSGG) has emerged to capture multi-object relationships across v…
Graph GenerationQuestion AnsweringScene Graph GenerationVideo Captioning+2Unbiased Scene Graph Generation by Type-Aware Message Passing on Heterogeneous and Dual Graphs
Although great progress has been made in the research of unbiased scene graph generation, issues still hinder improving the predictive performance of both head and tail classes. An unbiased scene graph generation (TA-HDG…
graph constructionGraph GenerationScene Graph GenerationUnbiased Scene Graph GenerationTowards Unbiased and Robust Spatio-Temporal Scene Graph Generation and Anticipation
Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modelling objects and their evolving relationships over time. However, real-world visual relationships often exhib…
Graph GenerationScene Graph GenerationSpatio-temporal Scene GraphsVideo scene graph generationFederated Voxel Scene Graph for Intracranial Hemorrhage
Intracranial Hemorrhage is a potentially lethal condition whose manifestation is vastly diverse and shifts across clinical centers worldwide. Deep-learning-based solutions are starting to model complex relations between …
DiversityGraph GenerationScene Graph GenerationSituational Scene Graph for Structured Human-centric Situation Understanding
Graph based representation has been widely used in modelling spatio-temporal relationships in video understanding. Although effective, existing graph-based approaches focus on capturing the human-object relationships whi…
Graph GenerationPredicate ClassificationScene Graph GenerationVideo UnderstandingScene Graph Generation with Role-Playing Large Language Models
Current approaches for open-vocabulary scene graph generation (OVSGG) use vision-language models such as CLIP and follow a standard zero-shot pipeline -- computing similarity between the query image and the text embeddin…
DescriptiveGraph GenerationScene Graph GenerationPoint2Graph: An End-to-end Point Cloud-based 3D Open-Vocabulary Scene Graph for Robot Navigation
Current open-vocabulary scene graph generation algorithms highly rely on both 3D scene point cloud data and posed RGB-D images and thus have limited applications in scenarios where RGB-D images or camera poses are not re…
3D Open-Vocabulary Object DetectionGraph GenerationObjectobject-detection+3Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generation
DETR introduces a simplified one-stage framework for scene graph generation (SGG). However, DETR-based SGG models face two challenges: i) Sparse supervision, as each image typically contains fewer than 10 relation annota…
Graph GenerationRelationScene Graph GenerationTowards Localizing Structural Elements: Merging Geometrical Detection with Semantic Verification in RGB-D Data
RGB-D cameras supply rich and dense visual and spatial information for various robotics tasks such as scene understanding, map reconstruction, and localization. Integrating depth and visual information can aid robots in …
3D Plane Detection3d scene graph generationGraph GenerationPanoptic Segmentation+3Ensemble Predicate Decoding for Unbiased Scene Graph Generation
Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-g…
Graph GenerationScene Graph GenerationUnbiased Scene Graph GenerationTowards Flexible Visual Relationship Segmentation
Visual relationship understanding has been studied separately in human-object interaction(HOI) detection, scene graph generation(SGG), and referring relationships(RR) tasks. Given the complexity and interconnectedness of…
Graph GenerationHuman-Object Interaction DetectionScene Graph GenerationSegmentationVoxel Scene Graph for Intracranial Hemorrhage
Patients with Intracranial Hemorrhage (ICH) face a potentially life-threatening condition, and patient-centered individualized treatment remains challenging due to possible clinical complications. Deep-Learning-based met…
Decision MakingGraph Generationobject-detectionObject Detection+1