Adversarial Training for a Continuous Robustness Control Problem in Power Systems
We propose a new adversarial training approach for injecting robustness when designing controllers for upcoming cyber-physical power systems. Previous approaches relying deeply on simulations are not able to cope with the rising complexity and are too costly when used online in terms of computation budget. In comparison, our method proves to be computationally efficient online while displaying useful robustness properties. To do so we model an adversarial framework, propose the implementation of a fixed opponent policy and test it on a L2RPN (Learning to Run a Power Network) environment. This environment is a synthetic but realistic modeling of a cyber-physical system accounting for one third of the IEEE 118 grid. Using adversarial testing, we analyze the results of submitted trained agents from the robustness track of the L2RPN competition. We then further assess the performance of these agents in regards to the continuous N-1 problem through tailored evaluation metrics. We discover that some agents trained in an adversarial way demonstrate interesting preventive behaviors in that regard, which we discuss.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Efficient Adversarial Training in LLMs with Continuous Attacks
Large language models (LLMs) are vulnerable to adversarial attacks that can bypass their safety guardrails. In many domains, adversarial training has proven to be one of the most promising methods to reliably improve rob…
Toward Evaluating Robustness of Deep Reinforcement Learning with Continuous Control
Deep reinforcement learning has achieved great success in many previously difficult reinforcement learning tasks, yet recent studies show that deep RL agents are also unavoidably susceptible to adversarial perturbations,…
continuous-controlContinuous ControlDeep Reinforcement LearningMuJoCo+3Introducing Adaptive Continuous Adversarial Training (ACAT) to Enhance ML Robustness
Adversarial training enhances the robustness of Machine Learning (ML) models against adversarial attacks. However, obtaining labeled training and adversarial training data in network/cybersecurity domains is challenging …
Spam detectionRobust Deep Reinforcement Learning against Adversarial Perturbations on State Observations
A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislea…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Adversarially Robust Neural Networks via Optimal Control: Bridging Robustness with Lyapunov Stability
Deep neural networks are known to be vulnerable to adversarial perturbations. In this paper, we bridge adversarial robustness of neural nets with Lyapunov stability of dynamical systems. From this viewpoint, training neu…
Adversarial Robustness