Space-Time Forecasting of Dynamic Scenes with Motion-aware Gaussian Grouping
Forecasting dynamic scenes remains a fundamental challenge in computer vision, as limited observations make it difficult to capture coherent object-level motion and long-term temporal evolution. We present Motion Group-aware Gaussian Forecasting (MoGaF), a framework for long-term scene extrapolation built upon the 4D Gaussian Splatting representation. MoGaF introduces motion-aware Gaussian grouping and group-wise optimization to enforce physically consistent motion across both rigid and non-rigid regions, yielding spatially coherent dynamic representations. Leveraging this structured space-time representation, a lightweight forecasting module predicts future motion, enabling realistic and temporally stable scene evolution. Experiments on synthetic and real-world datasets demonstrate that MoGaF consistently outperforms existing baselines in rendering quality, motion plausibility, and long-term forecasting stability. Our project page is available at https://slime0519.github.io/mogaf
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Safe Local Motion Planning With Self-Supervised Freespace Forecasting
Safe local motion planning for autonomous driving in dynamic environments requires forecasting how the scene evolves. Practical autonomy stacks adopt a semantic object-centric representation of a dynamic scene and bu…
Autonomous DrivingMotion Planningobject-detectionObject Detection+1Motion Forecasting in Continuous Driving
Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion fore…
Autonomous DrivingMotion ForecastingGEM: Gaussian Evolution Model for Occupancy Forecasting and Motion Planning
Future 3D semantic occupancy forecasting and motion planning are central to autonomous driving, as they require models to reason about how surrounding scenes evolve and how the ego vehicle should act. Existing occupancy …
Autonomous DrivingMotion Planning3D Motion Decomposition for RGBD Future Dynamic Scene Synthesis
A future video is the 2D projection of a 3D scene with predicted camera and object motion. Accurate future video prediction inherently requires understanding of 3D motion and geometry of a scene. In this paper, we propos…
Video PredictionSoMoFormer: Multi-Person Pose Forecasting with Transformers
Human pose forecasting is a challenging problem involving complex human body motion and posture dynamics. In cases that there are multiple people in the environment, one's motion may also be influenced by the motion and …
Human Pose Forecastingmotion predictionMulti-Person Pose forecastingTime Series Analysis