paper-with-me

Papers

Analyzing statistical and computational tradeoffs of estimation procedures

2015-06-25 · Daniel L. Sussman, Alexander Volfovsky, Edoardo M. Airoldi

The recent explosion in the amount and dimensionality of data has exacerbated the need of trading off computational and statistical efficiency carefully, so that inference is both tractable and meaningful. We propose a framework that provides an explicit opportunity for practitioners to specify how much statistical risk they are willing to accept for a given computational cost, and leads to a theoretical risk-computation frontier for any given inference problem. We illustrate the tradeoff between risk and computation and illustrate the frontier in three distinct settings. First, we derive analytic forms for the risk of estimating parameters in the classical setting of estimating the mean and variance for normally distributed data and for the more general setting of parameters of an exponential family. The second example concentrates on computationally constrained Hodges-Lehmann estimators. We conclude with an evaluation of risk associated with early termination of iterative matrix inversion algorithms in the context of linear regression.

📄 PDF Abstract BibTeX arXiv:1506.07925

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On statistics, computation and scalability

2013-09-30 · Michael. I. Jordan

How should statistical procedures be designed so as to be scalable computationally to the massive datasets that are increasingly the norm? When coupled with the requirement that an answer to an inferential question be de…

Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval, Matrix Completion, and Blind Deconvolution

2017-11-28 · ICML 2018 · Cong Ma, Kaizheng Wang, Yuejie Chi, Yuxin Chen

Recent years have seen a flurry of activities in designing provably efficient nonconvex procedures for solving statistical estimation problems. Due to the highly nonconvex nature of the empirical loss, state-of-the-art p…

Low-Rank Matrix CompletionMatrix CompletionRetrieval

Computational-Statistical Tradeoffs from NP-hardness

2025-07-17 · Guy Blanc, Caleb Koch, Carmen Strassle, Li-Yang Tan

A central question in computer science and statistics is whether efficient algorithms can achieve the information-theoretic limits of statistical problems. Many computational-statistical tradeoffs have been shown under a…

Computational EfficiencyPAC learning

Distributed sequential method for analyzing massive data

2018-12-22 · Zhanfeng Wang, Yuan-Chin Ivan Chang

To analyse a very large data set containing lengthy variables, we adopt a sequential estimation idea and propose a parallel divide-and-conquer method. We conduct several conventional sequential estimation procedures sepa…

Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval and Matrix Completion

2018-07-01 · ICML 2018 7 · Cong Ma, Kaizheng Wang, Yuejie Chi, Yuxin Chen

Recent years have seen a flurry of activities in designing provably efficient nonconvex optimization procedures for solving statistical estimation problems. For various problems like phase retrieval or low-rank matr…

Low-Rank Matrix CompletionMatrix CompletionRetrieval