ODGR: Online Dynamic Goal Recognition

2024-07-23 · Matan Shamir, Osher Elhadad, Matthew E. Taylor, Reuth Mirsky

Traditionally, Reinforcement Learning (RL) problems are aimed at optimization of the behavior of an agent. This paper proposes a novel take on RL, which is used to learn the policy of another agent, to allow real-time recognition of that agent's goals. Goal Recognition (GR) has traditionally been framed as a planning problem where one must recognize an agent's objectives based on its observed actions. Recent approaches have shown how reinforcement learning can be used as part of the GR pipeline, but are limited to recognizing predefined goals and lack scalability in domains with a large goal space. This paper formulates a novel problem, "Online Dynamic Goal Recognition" (ODGR), as a first step to address these limitations. Contributions include introducing the concept of dynamic goals into the standard GR problem definition, revisiting common approaches by reformulating them using ODGR, and demonstrating the feasibility of solving ODGR in a navigation domain using transfer learning. These novel formulations open the door for future extensions of existing transfer learning-based GR methods, which will be robust to changing and expansive real-time environments.

📄 PDF Abstract BibTeX arXiv:2407.16220

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

On Modulating the Gradient for Meta-Learning

2020-08-01 · ECCV 2020 8 · Christian Simon, Piotr Koniusz, Richard Nock, Mehrtash Harandi

Inspired by optimization techniques, we propose a novel meta-learning algorithm with gradient modulation to encourage fast-adaptation of neural networks in the absence of abundant data. Our method, termed ModGrad, is des…

Meta-Learning

CoDGraD: A Code-based Distributed Gradient Descent Scheme for Decentralized Convex Optimization

2022-04-13 · Elie Atallah, Nazanin Rahnavard, Qiyu Sun

In this paper, we consider a large network containing many regions such that each region is equipped with a worker with some data processing and communication capability. For such a network, some workers may become strag…

Heuristic Online Goal Recognition in Continuous Domains

2017-09-28 · Mor Vered, Gal A. Kaminka

Goal recognition is the problem of inferring the goal of an agent, based on its observed actions. An inspiring approach - plan recognition by planning (PRP) - uses off-the-shelf planners to dynamically generate plans for…

Goal Recognition as Reinforcement Learning

2022-02-13 · Leonardo Rosa Amado, Reuth Mirsky, Felipe Meneguzzi

Most approaches for goal recognition rely on specifications of the possible dynamics of the actor in the environment when pursuing a goal. These specifications suffer from two key issues. First, encoding these dynamics r…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Online Goal Recognition using Path Signature and Dynamic Time Warping

2026-05-08 · Douglas Tesch, Nathan Gavenski, Leonardo Amado, Odinaldo Rodrigues 외 arxiv

Online goal recognition in continuous domains poses two central challenges: efficiently encoding large trajectories and effectively comparing them. Recent work addresses these challenges by using custom state-space repre…