ProspectNet: Weighted Conditional Attention for Future Interaction Modeling in Behavior Prediction
Behavior prediction plays an important role in integrated autonomous driving software solutions. In behavior prediction research, interactive behavior prediction is a less-explored area, compared to single-agent behavior prediction. Predicting the motion of interactive agents requires initiating novel mechanisms to capture the joint behaviors of the interactive pairs. In this work, we formulate the end-to-end joint prediction problem as a sequential learning process of marginal learning and joint learning of vehicle behaviors. We propose ProspectNet, a joint learning block that adopts the weighted attention score to model the mutual influence between interactive agent pairs. The joint learning block first weighs the multi-modal predicted candidate trajectories, then updates the ego-agent's embedding via cross attention. Furthermore, we broadcast the individual future predictions for each interactive agent into a pair-wise scoring module to select the top $K$ prediction pairs. We show that ProspectNet outperforms the Cartesian product of two marginal predictions, and achieves comparable performance on the Waymo Interactive Motion Prediction benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingmotion predictionPredictionSimilar Papers 제목 키워드 기반
EDGE-Rec: Efficient and Data-Guided Edge Diffusion For Recommender Systems Graphs
Most recommender systems research focuses on binary historical user-item interaction encodings to predict future interactions. User features, item features, and interaction strengths remain largely under-utilized in this…
Collaborative FilteringDenoisingImage GenerationRecommendation SystemsAC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Prediction
Anticipating human motion in crowded scenarios is essential for developing intelligent transportation systems, social-aware robots and advanced video surveillance applications. A key component of this task is represented…
Graph AttentionMulti-future Trajectory PredictionMulti Future Trajectory PredictionTrajectory PredictionMultiple Futures Prediction
Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcom…
motion predictionPredictionMultiple Futures Prediction
Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcom…
motion predictionPredictionSequence Diffusion Model for Temporal Link Prediction in Continuous-Time Dynamic Graph
Temporal link prediction in dynamic graphs is a fundamental problem in many real-world systems. Existing temporal graph neural networks mainly focus on learning representations of historical interactions. Despite their s…
Link PredictionGraph Learning