paper-with-me

Papers

InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Model

2026-03-12 · InSpatio Team, Donghui Shen, Guofeng Zhang, Haomin Liu, Haoyu Ji, Jialin Liu, Jing Guo, Nan Wang, Siji Pan, Weihong Pan, Weijian Xie, Xiaojun Xiang, Xiaoyu Zhang, Xianbin Liu, Yifu Wang, Yipeng Chen, Zhewen Le, Zhichao Ye, Ziqiang Zhao arxiv

We present InSpatio-WorldFM, an open-source real-time frame model for spatial intelligence. Unlike video-based world models that rely on sequential frame generation and incur substantial latency due to window-level processing, InSpatio-WorldFM adopts a frame-based paradigm that generates each frame independently, enabling low-latency real-time spatial inference. By enforcing multi-view spatial consistency through explicit 3D anchors and implicit spatial memory, the model preserves global scene geometry while maintaining fine-grained visual details across viewpoint changes. We further introduce a progressive three-stage training pipeline that transforms a pretrained image diffusion model into a controllable frame model and finally into a real-time generator through few-step distillation. Experimental results show that InSpatio-WorldFM achieves strong multi-view consistency while supporting interactive exploration on consumer-grade GPUs, providing an efficient alternative to traditional video-based world models for real-time world simulation.

📄 PDF Abstract BibTeX arXiv:2603.11911

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling

2026-04-08 · InSpatio Team, Donghui Shen, Guofeng Zhang, Haomin Liu 외 arxiv

Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insu…

Video Generation

SparseCam4D: Spatio-Temporally Consistent 4D Reconstruction from Sparse Cameras

2026-03-27 · Weihong Pan, Xiaoyu Zhang, Zhuang Zhang, Zhichao Ye 외 arxiv

High-quality 4D reconstruction enables photorealistic and immersive rendering of the dynamic real world. However, unlike static scenes that can be fully captured with a single camera, high-quality dynamic scenes typicall…

Dynamic Reconstruction

RePAD2: Real-Time, Lightweight, and Adaptive Anomaly Detection for Open-Ended Time Series

2023-03-01 · Ming-Chang Lee, Jia-Chun Lin

An open-ended time series refers to a series of data points indexed in time order without an end. Such a time series can be found everywhere due to the prevalence of Internet of Things. Providing lightweight and real-tim…

Anomaly DetectionTime SeriesTime Series AnalysisTime Series Anomaly Detection

Low-latency Real-time Voice Conversion on CPU

2023-11-01 · Konstantine Sadov, Matthew Hutter, Asara Near

We adapt the architectures of previous audio manipulation and generation neural networks to the task of real-time any-to-one voice conversion. Our resulting model, LLVC ($\textbf{L}$ow-latency $\textbf{L}$ow-resource $\t…

CPUKnowledge DistillationVoice Conversion

OpenNIRScap: An Open-Source, Low-Cost Wearable Near-Infrared Spectroscopy-based Brain Interfacing Cap

2025-05-26 · Tony Kim, Haotian Liu, Chiung-Ting Huang, Ingrid Wu 외

Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive, real-time method for monitoring brain activity by measuring hemodynamic responses in the cerebral cortex. However, existing systems are expensive, bulky, a…