paper-with-me

Papers

RS2G: Data-Driven Scene-Graph Extraction and Embedding for Robust Autonomous Perception and Scenario Understanding

2023-04-17 · Junyao Wang, Arnav Vaibhav Malawade, JunHong Zhou, Shih-Yuan Yu, Mohammad Abdullah Al Faruque

Effectively capturing intricate interactions among road users is of critical importance to achieving safe navigation for autonomous vehicles. While graph learning (GL) has emerged as a promising approach to tackle this challenge, existing GL models rely on predefined domain-specific graph extraction rules that often fail in real-world drastically changing scenarios. Additionally, these graph extraction rules severely impede the capability of existing GL methods to generalize knowledge across domains. To address this issue, we propose RoadScene2Graph (RS2G), an innovative autonomous scenario understanding framework with a novel data-driven graph extraction and modeling approach that dynamically captures the diverse relations among road users. Our evaluations demonstrate that on average RS2G outperforms the state-of-the-art (SOTA) rule-based graph extraction method by 4.47% and the SOTA deep learning model by 22.19% in subjective risk assessment. More importantly, RS2G delivers notably better performance in transferring knowledge gained from simulation environments to unseen real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2304.08600

Code (1)

aicps/rs2g 공식 구현 pytorch

Tasks

Autonomous VehiclesGraph LearningNavigateScene UnderstandingTransfer Learning

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Self Supervised Clustering of Traffic Scenes using Graph Representations

2022-11-24 · Maximilian Zipfl, Moritz Jarosch, J. Marius Zöllner

Examining graphs for similarity is a well-known challenge, but one that is mandatory for grouping graphs together. We present a data-driven method to cluster traffic scenes that is self-supervised, i.e. without manual la…

ClusteringGraph Embedding

Learning and Reasoning with the Graph Structure Representation in Robotic Surgery

2020-07-07 · Mobarakol Islam, Lalithkumar Seenivasan, Lim Chwee Ming, Hongliang Ren

Learning to infer graph representations and performing spatial reasoning in a complex surgical environment can play a vital role in surgical scene understanding in robotic surgery. For this purpose, we develop an approac…

Edge ClassificationGraph GenerationScene Graph GenerationScene Segmentation+2

DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generation

2025-03-18 · CVPR 2025 1 · Mu Chen, Liulei Li, Wenguan Wang, Yi Yang

Top-leading solutions for Video Scene Graph Generation (VSGG) typically adopt an offline pipeline. Though demonstrating promising performance, they remain unable to handle real-time video streams and consume large GPU me…

DenoisingGPUGraph GenerationScene Graph Generation+1

Open-Vocabulary Object Detection via Scene Graph Discovery

2023-07-07 · Hengcan Shi, Munawar Hayat, Jianfei Cai

In recent years, open-vocabulary (OV) object detection has attracted increasing research attention. Unlike traditional detection, which only recognizes fixed-category objects, OV detection aims to detect objects in an op…

DecoderGraph GenerationObjectobject-detection+6

Contextual Graph Representations for Task-Driven 3D Perception and Planning

2026-03-12 · Christopher Agia arxiv

Recent advances in computer vision facilitate fully automatic extraction of object-centric relational representations from visual-inertial data. These state representations, dubbed 3D scene graphs, are a hierarchical dec…

Robot Task Planning