paper-with-me

Papers

A Conceptual Framework for Externally-influenced Agents: An Assisted Reinforcement Learning Review

2020-07-03 · Adam Bignold, Francisco Cruz, Matthew E. Taylor, Tim Brys, Richard Dazeley, Peter Vamplew, Cameron Foale

A long-term goal of reinforcement learning agents is to be able to perform tasks in complex real-world scenarios. The use of external information is one way of scaling agents to more complex problems. However, there is a general lack of collaboration or interoperability between different approaches using external information. In this work, while reviewing externally-influenced methods, we propose a conceptual framework and taxonomy for assisted reinforcement learning, aimed at fostering collaboration by classifying and comparing various methods that use external information in the learning process. The proposed taxonomy details the relationship between the external information source and the learner agent, highlighting the process of information decomposition, structure, retention, and how it can be used to influence agent learning. As well as reviewing state-of-the-art methods, we identify current streams of reinforcement learning that use external information in order to improve the agent's performance and its decision-making process. These include heuristic reinforcement learning, interactive reinforcement learning, learning from demonstration, transfer learning, and learning from multiple sources, among others. These streams of reinforcement learning operate with the shared objective of scaffolding the learner agent. Lastly, we discuss further possibilities for future work in the field of assisted reinforcement learning systems.

📄 PDF Abstract BibTeX arXiv:2007.01544

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Transfer Learning

Similar Papers 제목 키워드 기반

Probe-Based Interventions for Modifying Agent Behavior

2022-01-26 · Mycal Tucker, William Kuhl, Khizer Shahid, Seth Karten 외

Neural nets are powerful function approximators, but the behavior of a given neural net, once trained, cannot be easily modified. We wish, however, for people to be able to influence neural agents' actions despite the ag…

Decision MakingMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

What Do LLM Agents Do When Left Alone? Evidence of Spontaneous Meta-Cognitive Patterns

2025-09-25 · Stefan Szeider arxiv

We introduce an architecture for studying the behavior of large language model (LLM) agents in the absence of externally imposed tasks. Our continuous reason and act framework, using persistent memory and self-feedback, …

The Calibration Turn in AI-Assisted Research: A Conceptual and Methodological Framework for Evidence-Licensed Claims

2026-06-30 · Hongmin Li arxiv

AI-assisted research has entered a stage in which the central question is not only whether systems can generate hypotheses, run experiments, or produce manuscripts, but whether their scientific claims are calibrated to t…

From Found to Designed: Concepts as a Design Axis for Large Language Models

2026-07-29 · Chen Shani arxiv

Large language models (LLMs) encode rich concept-like information, but represent it implicitly through distributed statistical associations rather than as explicit, structured, compositional concepts. Consequently, conce…

Counterfactual Basis Extension and Representational Geometry: An MDL-Constrained Model of Conceptual Growth

2025-12-21 · Chainarong Amornbunchornvej arxiv

Concept learning becomes possible only when existing representations fail to account for experience. Most models of learning and inference, however, presuppose a fixed representational basis within which belief updating …