paper-with-me

홈 › Papers

Communication-Efficient Distributed Estimation and Inference for Cox's Model

2023-02-23 · Pierre Bayle, Jianqing Fan, Zhipeng Lou

Motivated by multi-center biomedical studies that cannot share individual data due to privacy and ownership concerns, we develop communication-efficient iterative distributed algorithms for estimation and inference in the high-dimensional sparse Cox proportional hazards model. We demonstrate that our estimator, even with a relatively small number of iterations, achieves the same convergence rate as the ideal full-sample estimator under very mild conditions. To construct confidence intervals for linear combinations of high-dimensional hazard regression coefficients, we introduce a novel debiased method, establish central limit theorems, and provide consistent variance estimators that yield asymptotically valid distributed confidence intervals. In addition, we provide valid and powerful distributed hypothesis tests for any coordinate element based on a decorrelated score test. We allow time-dependent covariates as well as censored survival times. Extensive numerical experiments on both simulated and real data lend further support to our theory and demonstrate that our communication-efficient distributed estimators, confidence intervals, and hypothesis tests improve upon alternative methods.

📄 PDF Abstract BibTeX arXiv:2302.12111

Code (0)

등록된 구현이 없습니다.

Tasks

valid

Similar Papers 제목 키워드 기반

Communication-Efficient Distributed Statistical Inference

2016-05-25 · Michael. I. Jordan, Jason D. Lee, Yun Yang

We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used…

Bayesian InferenceComputational Efficiency

Minimax and Communication-Efficient Distributed Best Subset Selection with Oracle Property

2024-08-30 · Jingguo Lan, Hongmei Lin, Xueqin Wang

The explosion of large-scale data in fields such as finance, e-commerce, and social media has outstripped the processing capabilities of single-machine systems, driving the need for distributed statistical inference meth…

Robust Testing and Estimation under Manipulation Attacks

2021-04-21 · Jayadev Acharya, Ziteng Sun, Huanyu Zhang

We study robust testing and estimation of discrete distributions in the strong contamination model. We consider both the "centralized setting" and the "distributed setting with information constraints" including communic…

Distributed Variational Inference for Online Supervised Learning

2023-09-05 · Parth Paritosh, Nikolay Atanasov, Sonia Martinez

Developing efficient solutions for inference problems in intelligent sensor networks is crucial for the next generation of location, tracking, and mapping services. This paper develops a scalable distributed probabilisti…

Binary ClassificationVariational Inference

Distributed Nonparametric Estimation under Communication Constraints

2022-04-21 · Azeem Zaman, Botond Szabó

In the era of big data, it is necessary to split extremely large data sets across multiple computing nodes and construct estimators using the distributed data. When designing distributed estimators, it is desirable to mi…

Density Estimationregression