RS2G: Data-Driven Scene-Graph Extraction and Embedding for Robust Autonomous Perception and Scenario Understanding
Effectively capturing intricate interactions among road users is of critical importance to achieving safe navigation for autonomous vehicles. While graph learning (GL) has emerged as a promising approach to tackle this challenge, existing GL models rely on predefined domain-specific graph extraction rules that often fail in real-world drastically changing scenarios. Additionally, these graph extraction rules severely impede the capability of existing GL methods to generalize knowledge across domains. To address this issue, we propose RoadScene2Graph (RS2G), an innovative autonomous scenario understanding framework with a novel data-driven graph extraction and modeling approach that dynamically captures the diverse relations among road users. Our evaluations demonstrate that on average RS2G outperforms the state-of-the-art (SOTA) rule-based graph extraction method by 4.47% and the SOTA deep learning model by 22.19% in subjective risk assessment. More importantly, RS2G delivers notably better performance in transferring knowledge gained from simulation environments to unseen real-world scenarios.
Code (1)
Tasks
Autonomous VehiclesGraph LearningNavigateScene UnderstandingTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self Supervised Clustering of Traffic Scenes using Graph Representations
Examining graphs for similarity is a well-known challenge, but one that is mandatory for grouping graphs together. We present a data-driven method to cluster traffic scenes that is self-supervised, i.e. without manual la…
ClusteringGraph EmbeddingLearning and Reasoning with the Graph Structure Representation in Robotic Surgery
Learning to infer graph representations and performing spatial reasoning in a complex surgical environment can play a vital role in surgical scene understanding in robotic surgery. For this purpose, we develop an approac…
Edge ClassificationGraph GenerationScene Graph GenerationScene Segmentation+2DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generation
Top-leading solutions for Video Scene Graph Generation (VSGG) typically adopt an offline pipeline. Though demonstrating promising performance, they remain unable to handle real-time video streams and consume large GPU me…
DenoisingGPUGraph GenerationScene Graph Generation+1Open-Vocabulary Object Detection via Scene Graph Discovery
In recent years, open-vocabulary (OV) object detection has attracted increasing research attention. Unlike traditional detection, which only recognizes fixed-category objects, OV detection aims to detect objects in an op…
DecoderGraph GenerationObjectobject-detection+6Contextual Graph Representations for Task-Driven 3D Perception and Planning
Recent advances in computer vision facilitate fully automatic extraction of object-centric relational representations from visual-inertial data. These state representations, dubbed 3D scene graphs, are a hierarchical dec…
Robot Task Planning