SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networks
Understanding traffic scenes requires considering heterogeneous information about dynamic agents and the static infrastructure. In this work we propose SCENE, a methodology to encode diverse traffic scenes in heterogeneous graphs and to reason about these graphs using a heterogeneous Graph Neural Network encoder and task-specific decoders. The heterogeneous graphs, whose structures are defined by an ontology, consist of different nodes with type-specific node features and different relations with type-specific edge features. In order to exploit all the information given by these graphs, we propose to use cascaded layers of graph convolution. The result is an encoding of the scene. Task-specific decoders can be applied to predict desired attributes of the scene. Extensive evaluation on two diverse binary node classification tasks show the main strength of this methodology: despite being generic, it even manages to outperform task-specific baselines. The further application of our methodology to the task of node classification in various knowledge graphs shows its transferability to other domains.
Code (1)
Tasks
Graph Neural NetworkKnowledge GraphsNode ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping
Accurately depicting the complex traffic scene is a vital component for autonomous vehicles to execute correct judgments. However, existing benchmarks tend to oversimplify the scene by solely focusing on lane perception …
3D Lane DetectionAutonomous VehiclesLane DetectionnuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction
Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of veh…
Knowledge GraphsPredictionTrajectory PredictionInformation Coordination as a Bridge: A Neuro-Symbolic Architecture for Reliable Autonomous Driving Scene Understanding
Reliable autonomous driving requires scene understanding that is semantically consistent across heterogeneous sensors and verifiable at the reasoning stage. However, many recent LLM-driven driving systems attach the lang…
Scene UnderstandingAutonomous DrivingCAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos
Road traffic scene reconstruction from videos has been desirable by road safety regulators, city planners, researchers, and autonomous driving technology developers. However, it is expensive and unnecessary to cover ever…
Autonomous DrivingT2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving
Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph e…
Autonomous Drivingcounterfactual