paper-with-me

홈 › Papers

TOFG: A Unified and Fine-Grained Environment Representation in Autonomous Driving

2023-05-31 · Zihao Wen, Yifan Zhang, Xinhong Chen, JianPing Wang

In autonomous driving, an accurate understanding of environment, e.g., the vehicle-to-vehicle and vehicle-to-lane interactions, plays a critical role in many driving tasks such as trajectory prediction and motion planning. Environment information comes from high-definition (HD) map and historical trajectories of vehicles. Due to the heterogeneity of the map data and trajectory data, many data-driven models for trajectory prediction and motion planning extract vehicle-to-vehicle and vehicle-to-lane interactions in a separate and sequential manner. However, such a manner may capture biased interpretation of interactions, causing lower prediction and planning accuracy. Moreover, separate extraction leads to a complicated model structure and hence the overall efficiency and scalability are sacrificed. To address the above issues, we propose an environment representation, Temporal Occupancy Flow Graph (TOFG). Specifically, the occupancy flow-based representation unifies the map information and vehicle trajectories into a homogeneous data format and enables a consistent prediction. The temporal dependencies among vehicles can help capture the change of occupancy flow timely to further promote model performance. To demonstrate that TOFG is capable of simplifying the model architecture, we incorporate TOFG with a simple graph attention (GAT) based neural network and propose TOFG-GAT, which can be used for both trajectory prediction and motion planning. Experiment results show that TOFG-GAT achieves better or competitive performance than all the SOTA baselines with less training time.

📄 PDF Abstract BibTeX arXiv:2305.20068

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingGraph AttentionMotion PlanningPredictionTrajectory Prediction

Similar Papers 제목 키워드 기반

PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding

2026-06-04 · Shaohui Dai, Yansong Qu, You Shen, Shengchuan Zhang 외 arxiv

Recent advances in 3D multimodal large language models (3D-MLLMs) have enabled unified solutions for 3D scene understanding tasks, including visual question answering, captioning, and referring segmentation. However, exi…

Visual Question AnsweringRepresentation LearningScene Understanding

ReSemAct: Advancing Fine-Grained Robotic Manipulation via Semantic Structuring and Affordance Refinement

2025-07-24 · Chenyu Su, Weiwei Shang, Chen Qian, Fei Zhang 외 arxiv

Fine-grained robotic manipulation requires grounding natural language into appropriate affordance targets. However, most existing methods driven by foundation models often compress rich semantics into oversimplified affo…

FGU3R: Fine-Grained Fusion via Unified 3D Representation for Multimodal 3D Object Detection

2025-01-08 · Guoxin Zhang, Ziying Song, Lin Liu, Zhonghong Ou

Multimodal 3D object detection has garnered considerable interest in autonomous driving. However, multimodal detectors suffer from dimension mismatches that derive from fusing 3D points with 2D pixels coarsely, which lea…

3D Object DetectionAutonomous Drivingmultimodal interactionobject-detection+1

Volumetric Environment Representation for Vision-Language Navigation

2024-03-21 · CVPR 2024 1 · Rui Liu, Wenguan Wang, Yi Yang

Vision-language navigation (VLN) requires an agent to navigate through an 3D environment based on visual observations and natural language instructions. It is clear that the pivotal factor for successful navigation lies …

3D geometryMulti-Task LearningNavigateScene Understanding+2

Aligned to the Object, not to the Image: A Unified Pose-aligned Representation for Fine-grained Recognition

2018-01-27 · Pei Guo, Ryan Farrell

Dramatic appearance variation due to pose constitutes a great challenge in fine-grained recognition, one which recent methods using attention mechanisms or second-order statistics fail to adequately address. Modern CNNs …

Fine-Grained Image ClassificationObjectPose Estimation