Generic Probabilistic Interactive Situation Recognition and Prediction: From Virtual to Real
Accurate and robust recognition and prediction of traffic situation plays an important role in autonomous driving, which is a prerequisite for risk assessment and effective decision making. Although there exist a lot of works dealing with modeling driver behavior of a single object, it remains a challenge to make predictions for multiple highly interactive agents that react to each other simultaneously. In this work, we propose a generic probabilistic hierarchical recognition and prediction framework which employs a two-layer Hidden Markov Model (TLHMM) to obtain the distribution of potential situations and a learning-based dynamic scene evolution model to sample a group of future trajectories. Instead of predicting motions of a single entity, we propose to get the joint distribution by modeling multiple interactive agents as a whole system. Moreover, due to the decoupling property of the layered structure, our model is suitable for knowledge transfer from simulation to real world applications as well as among different traffic scenarios, which can reduce the computational efforts of training and the demand for a large data amount. A case study of highway ramp merging scenario is demonstrated to verify the effectiveness and accuracy of the proposed framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDecision MakingTransfer LearningSimilar Papers 제목 키워드 기반
Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Prediction
Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected …
Autonomous DrivingAutonomous VehiclesNavigateEvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational Reasoning
Multi-agent interacting systems are prevalent in the world, from pure physical systems to complicated social dynamic systems. In many applications, effective understanding of the situation and accurate trajectory predict…
Autonomous DrivingAutonomous VehiclesDecision MakingPrediction+3Generic Tracking and Probabilistic Prediction Framework and Its Application in Autonomous Driving
Accurately tracking and predicting behaviors of surrounding objects are key prerequisites for intelligent systems such as autonomous vehicles to achieve safe and high-quality decision making and motion planning. However,…
Autonomous DrivingAutonomous VehiclesDecision MakingMotion Planning+4Towards a Fatality-Aware Benchmark of Probabilistic Reaction Prediction in Highly Interactive Driving Scenarios
Autonomous vehicles should be able to generate accurate probabilistic predictions for uncertain behavior of other road users. Moreover, reactive predictions are necessary in highly interactive driving scenarios to answer…
Autonomous VehiclesDecision MakingReinforcement LearningEffectively Leveraging CLIP for Generating Situational Summaries of Images and Videos
Situation recognition refers to the ability of an agent to identify and understand various situations or contexts based on available information and sensory inputs. It involves the cognitive process of interpreting data …
Semantic Role LabelingVideo Captioning