The Need for a Big World Simulator: A Scientific Challenge for Continual Learning
The "small agent, big world" frame offers a conceptual view that motivates the need for continual learning. The idea is that a small agent operating in a much bigger world cannot store all information that the world has to offer. To perform well, the agent must be carefully designed to ingest, retain, and eject the right information. To enable the development of performant continual learning agents, a number of synthetic environments have been proposed. However, these benchmarks suffer from limitations, including unnatural distribution shifts and a lack of fidelity to the "small agent, big world" framing. This paper aims to formalize two desiderata for the design of future simulated environments. These two criteria aim to reflect the objectives and complexity of continual learning in practical settings while enabling rapid prototyping of algorithms on a smaller scale.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningSimilar Papers 제목 키워드 기반
Towards Continual Reinforcement Learning for Quadruped Robots
Quadruped robots have emerged as an evolving technology that currently leverages simulators to develop a robust controller capable of functioning in the real-world without the need for further training. However, since it…
Continual Learningreinforcement-learningReinforcement LearningSimulRAG: Simulator-based RAG for Grounding LLMs in Long-form Scientific QA
Large Language Models (LLMs) show promise in generating long-form scientific explanations that synthesize evidence and connect multiple factors. However, in long-form scientific question answering, LLMs often hallucinate…
Question AnsweringCan Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearning
Language models (LMs) are trained on static scientific corpora, whereas scientific knowledge continuously evolves through correction and revision. Scientific claims encoded within these models may later become retracted,…
Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature
The scientific community continues to publish an overwhelming amount of new research related to COVID-19 on a daily basis, leading to much literature without little to no attention. To aid the community in understanding …
Continual LearningExtractive SummarizationSelf-Evolving Cognitive Framework via Causal World Modeling for Embodied Scientific Intelligence
Current embodied world models are primarily optimized for predictive objectives, limiting their ability to generalize under distribution shifts and reason systematically about unseen situations and hypothetical intervent…