Papers Video Prediction
“Video Prediction” 태그가 달린 논문 470편 · 필터 해제
ActiveWAM: Evidence-Aware Active Vision for World-Action Models
Active vision manipulation requires a policy to control both its camera and its end-effectors, yet camera motion determines which evidence remains visible within finite observation windows. Acquiring a new view can displ…
Video PredictionMinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception
Modeling spatiotemporal coupling is a key challenge in building physical intelligence across scales, from microscopic to macroscopic. Existing models capture such structure broadly through physics-motivated dynamical for…
Video PredictionXPACE: Joint World and Action Modeling from Heterogeneous Experience
A general-purpose robot needs to draw on diverse experience, choose actions, and anticipate how those actions will change the world. We introduce XPACE, a unified embodied world model that serves as both a world action m…
Video PredictionGeoLAM: Learning Geometry-Grounded Latent Actions from Unlabeled Human Videos
Human videos provide rich manipulation experience, but extracting action representations that preserve useful motion remains challenging. Visual reconstruction alone can entangle manipulation-related motion with appearan…
Video PredictionVideo GenerationAcrossVAM1.0: Particle World Modeling for Text-Assisted Robot Video Prediction
Predicting robot videos requires both precise motion reasoning and preservation of high-frequency appearance, yet monolithic pixel models entangle these objectives and often conceal their progress behind a strong last-fr…
Video PredictionDECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly dis…
Video PredictionV-RAE: Rethinking Video Latent Spaces for Generation
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized pr…
Video ReconstructionVideo GenerationVideo PredictionContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approa…
Video PredictionGeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
Generalist robot policies exhibit strong capabilities, but their robustness in complex and unseen environments remains limited. Scaling robot learning and evaluation in diverse real-world environments remains costly and …
Zero-shot GeneralizationVideo PredictionHOPE: Hand-Object Pressure Estimation from Monocular Videos
Estimating physical pressure from vision is essential for understanding contact-rich hand-object interaction. However, prior vision-based pressure estimation methods are largely limited to planar surfaces and single imag…
Video PredictionCrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction
Visual world models typically learn future dynamics from a single observation stream, limiting their ability to model cooperative systems with multiple independently moving observers. We investigate this challenge in Mot…
Video PredictionVideo GenerationDC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Models
World-Action Models (WAMs) augment robot policies with future visual prediction, but it remains unclear what the visual modality should learn for control. While photorealistic future prediction provides dense supervision…
Video PredictionN_0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
We present N_0-TWAM, a tactile-native world-action model for contact-rich manipulation that predicts both future vision and future contact. To our knowledge, it is the first tactile world-action model trained at large sc…
Video PredictionMotionForesight: Re-purposing Video Models for Future 3D Scene-Flow Prediction
Humans can infer how objects are likely to move from passive observation: a cup may be lifted, a drawer may slide, and a lid may rotate shut. Such predictions expose the physical consequences of interaction needed to act…
Motion ForecastingVideo PredictionWAM-TTT: Steering World-Action Models by Watching Human Play at Test Time
Steering robot foundation models (RFMs) toward new task variants or user-preferred behaviors remains challenging, often requiring additional robot demonstrations, task-specific fine-tuning, or long-context conditioning. …
Video PredictionUNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation
World Action Models (WAMs) have shown strong potential for improving action generalization in autonomous driving by using future video prediction as dense supervision for scene dynamics and temporal causality. However, i…
Autonomous DrivingVideo PredictionVideo DenoisingSUNTA: Hierarchical Video Prediction with Surprise-based Chunking
Hierarchical state-space models (HSSMs) offer a promising approach to long-horizon prediction by segmenting sequences into temporal chunks. However, their performance hinges on how chunk boundaries are determined. While …
Boundary DetectionVideo PredictionFrom World Models to World Action Models: A Concise Tutorial for Robotics
Rather than providing an exhaustive survey, this paper presents a concise tutorial on world models and world action models for robotics. After reading the tutorial, readers should have a clear understanding of what const…
Video PredictionLearning Video Dynamics with Predictive Differentiable Rendering
How to accurately predict a high-fidelity future world? While the visual world is inherently continuous, existing deterministic video prediction models operate in discrete pixel space and are mainly optimized with pixel-…
3D ReconstructionVideo PredictionNot All Actions Are Equal: Rethinking Conditioning for Dexterous World Model
Recent advances in action-conditioned world models show promising progress in modeling complex interactions and forecasting future states under diverse action sequences. While these models are often driven by stronger vi…
Video Prediction