paper-with-me

Papers

DR-PETS: Learning-Based Control With Planning in Adversarial Environments

2025-03-26 · Hozefa Jesawada, Antonio Acernese, Giovanni Russo, Carmen Del Vecchio

Ensuring robustness against epistemic, possibly adversarial, perturbations is essential for reliable real-world decision-making. While the Probabilistic Ensembles with Trajectory Sampling (PETS) algorithm inherently handles uncertainty via ensemble-based probabilistic models, it lacks guarantees against structured adversarial or worst-case uncertainty distributions. To address this, we propose DR-PETS, a distributionally robust extension of PETS that certifies robustness against adversarial perturbations. We formalize uncertainty via a p-Wasserstein ambiguity set, enabling worst-case-aware planning through a min-max optimization framework. While PETS passively accounts for stochasticity, DR-PETS actively optimizes robustness via a tractable convex approximation integrated into PETS planning loop. Experiments on pendulum stabilization and cart-pole balancing show that DR-PETS certifies robustness against adversarial parameter perturbations, achieving consistent performance in worst-case scenarios where PETS deteriorates.

📄 PDF Abstract BibTeX arXiv:2503.20660

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Exploring Model-based Planning with Policy Networks

2019-06-20 · ICLR 2020 1 · Tingwu Wang, Jimmy Ba

Model-based reinforcement learning (MBRL) with model-predictive control or online planning has shown great potential for locomotion control tasks in terms of both sample efficiency and asymptotic performance. Despite the…

BenchmarkingmodelModel-based Reinforcement LearningModel Predictive Control+2

Dyna-AIL : Adversarial Imitation Learning by Planning

2019-03-08 · Vaibhav Saxena, Srinivasan Sivanandan, Pulkit Mathur

Adversarial methods for imitation learning have been shown to perform well on various control tasks. However, they require a large number of environment interactions for convergence. In this paper, we propose an end-to-e…

Imitation Learning

Game-theoretic Objective Space Planning

2022-09-16 · Hongrui Zheng, Zhijun Zhuang, Johannes Betz, Rahul Mangharam

Generating competitive strategies and performing continuous motion planning simultaneously in an adversarial setting is a challenging problem. In addition, understanding the intent of other agents is crucial to deploying…

Autonomous VehiclescounterfactualDimensionality ReductionMotion Planning

Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning

2023-05-28 · Weize Chen, Xu Han, Yankai Lin, Zhiyuan Liu 외

Parameter-efficient tuning methods (PETs) have achieved promising results in tuning large pre-trained language models (PLMs). By formalizing frozen PLMs and additional tunable parameters as systems and controls respectiv…

A Simple Decentralized Cross-Entropy Method

2022-12-16 · Zichen Zhang, Jun Jin, Martin Jagersand, Jun Luo 외

Cross-Entropy Method (CEM) is commonly used for planning in model-based reinforcement learning (MBRL) where a centralized approach is typically utilized to update the sampling distribution based on only the top-$k$ opera…

continuous-controlContinuous ControlModel-based Reinforcement Learning