paper-with-me

홈 › Papers

Value Iteration for Learning Concurrently Executable Robotic Control Tasks

2025-04-01 · Sheikh A. Tahmid, Gennaro Notomista

Many modern robotic systems such as multi-robot systems and manipulators exhibit redundancy, a property owing to which they are capable of executing multiple tasks. This work proposes a novel method, based on the Reinforcement Learning (RL) paradigm, to train redundant robots to be able to execute multiple tasks concurrently. Our approach differs from typical multi-objective RL methods insofar as the learned tasks can be combined and executed in possibly time-varying prioritized stacks. We do so by first defining a notion of task independence between learned value functions. We then use our definition of task independence to propose a cost functional that encourages a policy, based on an approximated value function, to accomplish its control objective while minimally interfering with the execution of higher priority tasks. This allows us to train a set of control policies that can be executed simultaneously. We also introduce a version of fitted value iteration to learn to approximate our proposed cost functional efficiently. We demonstrate our approach on several scenarios and robotic systems.

📄 PDF Abstract BibTeX arXiv:2504.01174

Code (1)

erablab/value_iteration_for_learning_concurrently_executable_robotic_control_tasks 공식 구현 pytorch

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?

2026-05-29 · Stephane Hatgis-Kessell, Emma Brunskill arxiv

We study when large language models (LLMs) can serve as effective black-box policy optimizers for reinforcement learning (RL) tasks, i.e., when can we replace classical RL algorithms with an LLM? We explore this question…

Reinforcement LearningContinuous Control

Continuous-Time Fitted Value Iteration for Robust Policies

2021-10-05 · Michael Lutter, Boris Belousov, Shie Mannor, Dieter Fox 외

Solving the Hamilton-Jacobi-Bellman equation is important in many domains including control, robotics and economics. Especially for continuous control, solving this differential equation and its extension the Hamilton-Ja…

continuous-controlContinuous ControlDeep Reinforcement Learning

Scaling Nonlinear Optimization: Many Problems One GPU

2026-06-24 · John Viljoen, Johanna Haffner, Masayoshi Tomizuka, Negar Mehr arxiv

Many robotics problems, including trajectory optimization, inverse kinematics, and contact-rich motion planning, reduce to nonlinear programs (NLPs). Mature NLP solvers such as IPOPT can solve these problems, offering ha…

Reinforcement LearningMotion Planning

Ternary Policy Iteration Algorithm for Nonlinear Robust Control

2020-07-14 · Jie Li, Shengbo Eben Li, Yang Guan, Jingliang Duan 외

The uncertainties in plant dynamics remain a challenge for nonlinear control problems. This paper develops a ternary policy iteration (TPI) algorithm for solving nonlinear robust control problems with bounded uncertainti…

From Prompt to Physical Action: Structured Backdoor Attacks on LLM-Mediated Robotic Control Systems

2026-04-04 · Mingyang Xie, Jin Wei-Kocsis arxiv

The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introdu…