paper-with-me

홈 › Papers

Zero-shot World Models Are Developmentally Efficient Learners

2026-04-11 · Khai Loong Aw, Klemen Kotar, Wanhee Lee, Seungwoo Kim, Khaled Jedoui, Rahul Venkatesh, Lilian Naing Chen, Michael C. Frank, Daniel L. K. Yamins arxiv

Young children demonstrate early abilities to understand their physical world, estimating depth, motion, object coherence, interactions, and many other aspects of physical scene understanding. Children are both data-efficient and flexible cognitive systems, creating competence despite extremely limited training data, while generalizing to myriad untrained tasks -- a major challenge even for today's best AI systems. Here we introduce a novel computational hypothesis for these abilities, the Zero-shot World Model (ZWM). ZWM is based on three principles: a sparse temporally-factored predictor that decouples appearance from dynamics; zero-shot estimation through approximate causal inference; and composition of inferences to build more complex abilities. We show that ZWM can be learned from the first-person experience of a single child, rapidly generating competence across multiple physical understanding benchmarks. It also shows progressive, staged emergence of capacities during learning and builds brain-like internal representations. Our work presents a blueprint for efficient and flexible learning from human-scale data, advancing both a computational account of children's early physical understanding and a path toward data-efficient AI systems.

📄 PDF Abstract BibTeX arXiv:2604.10333

Code (0)

등록된 구현이 없습니다.

Tasks

Scene UnderstandingCausal Inference

Similar Papers 제목 키워드 기반

What Makes Pre-trained Language Models Better Zero-shot Learners?

2022-09-30 · Jinghui Lu, Dongsheng Zhu, Weidong Han, Rui Zhao 외

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a r…

Language ModellingPrompt Learningtext-classificationText Classification+1

Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization

2023-02-01 · Lukas Haas, Silas Alberti, Michal Skreta

Image geolocalization is the challenging task of predicting the geographic coordinates of origin for a given photo. It is an unsolved problem relying on the ability to combine visual clues with general knowledge about th…

Generalized Zero-Shot LearningMeta-LearningPhoto geolocation estimationZero-Shot Learning

Projected Subnetworks Scale Adaptation

2023-01-27 · Siddhartha Datta, Nigel Shadbolt

Large models support great zero-shot and few-shot capabilities. However, updating these models on new tasks can break performance on previous seen tasks and their zero/few-shot unseen tasks. Our work explores how to upda…

Federated reinforcement learning for robot motion planning with zero-shot generalization

2024-03-20 · Zhenyuan Yuan, Siyuan Xu, Minghui Zhu

This paper considers the problem of learning a control policy for robot motion planning with zero-shot generalization, i.e., no data collection and policy adaptation is needed when the learned policy is deployed in new e…

Motion PlanningZero-shot Generalization

LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings

2024-08-25 · Duo Wang, Yuan Zuo, FengZhi Li, Junjie Wu

Zero-shot graph machine learning, especially with graph neural networks (GNNs), has garnered significant interest due to the challenge of scarce labeled data. While methods like self-supervised learning and graph prompt …

Language ModellingLink PredictionNode ClassificationPrompt Learning+2