paper-with-me

홈 › Papers

Convex Optimization for Linear Query Processing under Approximate Differential Privacy

2016-02-13 · Ganzhao Yuan, Yin Yang, Zhenjie Zhang, Zhifeng Hao

Differential privacy enables organizations to collect accurate aggregates over sensitive data with strong, rigorous guarantees on individuals' privacy. Previous work has found that under differential privacy, computing multiple correlated aggregates as a batch, using an appropriate \emph{strategy}, may yield higher accuracy than computing each of them independently. However, finding the best strategy that maximizes result accuracy is non-trivial, as it involves solving a complex constrained optimization program that appears to be non-linear and non-convex. Hence, in the past much effort has been devoted in solving this non-convex optimization program. Existing approaches include various sophisticated heuristics and expensive numerical solutions. None of them, however, guarantees to find the optimal solution of this optimization problem. This paper points out that under ($\epsilon$, $\delta$)-differential privacy, the optimal solution of the above constrained optimization problem in search of a suitable strategy can be found, rather surprisingly, by solving a simple and elegant convex optimization program. Then, we propose an efficient algorithm based on Newton's method, which we prove to always converge to the optimal solution with linear global convergence rate and quadratic local convergence rate. Empirical evaluations demonstrate the accuracy and efficiency of the proposed solution.

📄 PDF Abstract BibTeX arXiv:1602.04302

Code (1)

cmla-psu/matrixqueries

Similar Papers 제목 키워드 기반

Statistical Query Algorithms for Mean Vector Estimation and Stochastic Convex Optimization

2015-12-30 · Vitaly Feldman, Cristobal Guzman, Santosh Vempala

Stochastic convex optimization, where the objective is the expectation of a random convex function, is an important and widely used method with numerous applications in machine learning, statistics, operations research a…

BIG-bench Machine Learning

Accelerated Distributed Stochastic Non-Convex Optimization over Time-Varying Directed Networks

2024-10-11 · Yiyue Chen, Abolfazl Hashemi, Haris Vikalo

Distributed stochastic non-convex optimization problems have recently received attention due to the growing interest of signal processing, computer vision, and natural language processing communities in applications depl…

Federated Learningimage-classificationImage Classification

Variance Reduced methods for Non-convex Composition Optimization

2017-11-13 · Liu Liu, Ji Liu, DaCheng Tao

This paper explores the non-convex composition optimization in the form including inner and outer finite-sum functions with a large number of component functions. This problem arises in some important applications such a…

Reinforcement Learning

Upper-Linearizability of Online Non-Monotone DR-Submodular Maximization over Down-Closed Convex Sets

2026-02-24 · Yiyang Lu, Haresh Jadav, Mohammad Pedramfar, Ranveer Singh 외 arxiv

We study online maximization of non-monotone Diminishing-Return(DR)-submodular functions over down-closed convex sets, a regime where existing projection-free online methods suffer from suboptimal regret and limited feed…

Unveiling Hidden Convexity in Deep Learning: a Sparse Signal Processing Perspective

2026-03-25 · Emi Zeger, Mert Pilanci arxiv

Deep neural networks (DNNs), particularly those using Rectified Linear Unit (ReLU) activation functions, have achieved remarkable success across diverse machine learning tasks, including image recognition, audio processi…