Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps
Accurate prediction of driving scenes is essential for road safety and autonomous driving. Occupancy Grid Maps (OGMs) are commonly employed for scene prediction due to their structured spatial representation, flexibility across sensor modalities and integration of uncertainty. Recent studies have successfully combined OGMs with deep learning methods to predict the evolution of scene and learn complex behaviours. These methods, however, do not consider prediction of flow or velocity vectors in the scene. In this work, we propose a novel multi-task framework that leverages dynamic OGMs and semantic information to predict both future vehicle semantic grids and the future flow of the scene. This incorporation of semantic flow not only offers intermediate scene features but also enables the generation of warped semantic grids. Evaluation on the real-world NuScenes dataset demonstrates improved prediction capabilities and enhanced ability of the model to retain dynamic vehicles within the scene.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingmotion predictionPredictionSimilar Papers 제목 키워드 기반
CurriFlow: Curriculum-Guided Depth Fusion with Optical Flow-Based Temporal Alignment for 3D Semantic Scene Completion
Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods rel…
3D Semantic Scene CompletionAutonomous DrivingSemantics-aware Test-time Adaptation for 3D Human Pose Estimation
This work highlights a semantics misalignment in 3D human pose estimation. For the task of test-time adaptation, the misalignment manifests as overly smoothed and unguided predictions. The smoothing settles predictions t…
3D human pose and shape estimation3D Human Pose Estimation3D Pose Estimationmotion prediction+4Residual Flow Matching with Dynamic Cross-Interaction for 3D Multi-Person Motion Prediction
3D multi-person motion prediction requires modeling both individual kinematics and inter-person interactions. While Flow Matching is effective for multi-hypothesis generation to improve prediction accuracy, directly pred…
Motion Semantics Guided Normalizing Flow for Privacy-Preserving Video Anomaly Detection
As embodied perception systems increasingly bridge digital and physical realms in interactive multimedia applications, the need for privacy-preserving approaches to understand human activities in physical environments ha…
Video Anomaly DetectionLearning Temporal 3D Semantic Scene Completion via Optical Flow Guidance
3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods…
3D Semantic Scene CompletionAutonomous DrivingOptical Flow Estimation