paper-with-me

Papers

PPO-MI: Efficient Black-Box Model Inversion via Proximal Policy Optimization

2025-02-20 · Xinpeng Shou

Model inversion attacks pose a significant privacy risk by attempting to reconstruct private training data from trained models. Most of the existing methods either depend on gradient estimation or require white-box access to model parameters, which limits their applicability in practical scenarios. In this paper, we propose PPO-MI, a novel reinforcement learning-based framework for black-box model inversion attacks. Our approach formulates the inversion task as a Markov Decision Process, where an agent navigates the latent space of a generative model to reconstruct private training samples using only model predictions. By employing Proximal Policy Optimization (PPO) with a momentum-based state transition mechanism, along with a reward function balancing prediction accuracy and exploration, PPO-MI ensures efficient latent space exploration and high query efficiency. We conduct extensive experiments illustrates that PPO-MI outperforms the existing methods while require less attack knowledge, and it is robust across various model architectures and datasets. These results underline its effectiveness and generalizability in practical black-box scenarios, raising important considerations for the privacy vulnerabilities of deployed machine learning models.

📄 PDF Abstract BibTeX arXiv:2502.14370

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Taking gradients through experiments: LSTMs and memory proximal policy optimization for black-box quantum control

2018-02-12 · Moritz August, José Miguel Hernández-Lobato

In this work we introduce the application of black-box quantum control as an interesting rein- forcement learning problem to the machine learning community. We analyze the structure of the reinforcement learning problems…

Reinforcement Learning

PPO-CMA: Proximal Policy Optimization with Covariance Matrix Adaptation

2018-10-05 · Perttu Hämäläinen, Amin Babadi, Xiaoxiao Ma, Jaakko Lehtinen

Proximal Policy Optimization (PPO) is a highly popular model-free reinforcement learning (RL) approach. However, we observe that in a continuous action space, PPO can prematurely shrink the exploration variance, which le…

continuous-controlContinuous ControlReinforcement LearningReinforcement Learning (RL)

Riemannian Proximal Policy Optimization

2020-05-19 · Shijun Wang, Baocheng Zhu, Chen Li, Mingzhe Wu 외

In this paper, We propose a general Riemannian proximal optimization algorithm with guaranteed convergence to solve Markov decision process (MDP) problems. To model policy functions in MDP, we employ Gaussian mixture mod…

Proximal Policy Optimization with Mixed Distributed Training

2019-07-15 · Zhen-Yu Zhang, Xiangfeng Luo, Tong Liu, Shaorong Xie 외

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algori…

Deep Reinforcement LearningReinforcement Learning

An Explainable Deep Reinforcement Learning Model for Warfarin Maintenance Dosing Using Policy Distillation and Action Forging

2024-04-26 · Sadjad Anzabi Zadeh, W. Nick Street, Barrett W. Thomas

Deep Reinforcement Learning is an effective tool for drug dosing for chronic condition management. However, the final protocol is generally a black box without any justification for its prescribed doses. This paper addre…

Deep Reinforcement LearningManagement