paper-with-me

Papers

WorldGen: A Large Scale Generative Simulator

2022-10-03 · Chahat Deep Singh, Riya Kumari, Cornelia Fermüller, Nitin J. Sanket, Yiannis Aloimonos

In the era of deep learning, data is the critical determining factor in the performance of neural network models. Generating large datasets suffers from various difficulties such as scalability, cost efficiency and photorealism. To avoid expensive and strenuous dataset collection and annotations, researchers have inclined towards computer-generated datasets. Although, a lack of photorealism and a limited amount of computer-aided data, has bounded the accuracy of network predictions. To this end, we present WorldGen -- an open source framework to autonomously generate countless structured and unstructured 3D photorealistic scenes such as city view, object collection, and object fragmentation along with its rich ground truth annotation data. WorldGen being a generative model gives the user full access and control to features such as texture, object structure, motion, camera and lens properties for better generalizability by diminishing the data bias in the network. We demonstrate the effectiveness of WorldGen by presenting an evaluation on deep optical flow. We hope such a tool can open doors for future research in a myriad of domains related to robotics and computer vision by reducing manual labor and the cost of acquiring rich and high-quality data.

📄 PDF Abstract BibTeX arXiv:2210.00715

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectOptical Flow Estimation

Similar Papers 제목 키워드 기반

WorldGen: From Text to Traversable and Interactive 3D Worlds

2025-11-20 · Dilin Wang, Hyunyoung Jung, Tom Monnier, Kihyuk Sohn 외 arxiv

We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured…

3D Generation

BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

2026-08-23 · Jiaqi Wang, Zhuo Zhang, Haining Guan, Tingguang Zhou 외 arxiv

Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and the resulting data is fed back to refine the action model. However, the …

WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation

2025-05-02 · Daoan Zhang, Che Jiang, Ruoshi Xu, Biaoxiang Chen 외

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for…

Image GenerationText to Image GenerationText-to-Image GenerationWorld Knowledge

Dreamland: Controllable World Creation with Simulator and Generative Models

2025-06-09 · Sicheng Mo, Ziyang Leng, Leon Liu, Weizhen Wang 외

Large-scale video generative models can synthesize diverse and realistic visual content for dynamic world creation, but they often lack element-wise controllability, hindering their use in editing scenes and training emb…

Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving

2026-05-18 · Lijun Zhou, Hongcheng Luo, Zhenxin Zhu, Cheng Chi 외 arxiv

This report presents a unified technical system addressing the two core capabilities of world models for autonomous driving: world representation and world generation. For world representation, we propose WorldRec, a fee…

Autonomous DrivingVideo Generation