paper-with-me

Papers

Statistical Estimation from Dependent Data

2021-07-20 · Yuval Dagan, Constantinos Daskalakis, Nishanth Dikkala, Surbhi Goel, Anthimos Vardis Kandiros

We consider a general statistical estimation problem wherein binary labels across different observations are not independent conditioned on their feature vectors, but dependent, capturing settings where e.g. these observations are collected on a spatial domain, a temporal domain, or a social network, which induce dependencies. We model these dependencies in the language of Markov Random Fields and, importantly, allow these dependencies to be substantial, i.e do not assume that the Markov Random Field capturing these dependencies is in high temperature. As our main contribution we provide algorithms and statistically efficient estimation rates for this model, giving several instantiations of our bounds in logistic regression, sparse logistic regression, and neural network settings with dependent data. Our estimation guarantees follow from novel results for estimating the parameters (i.e. external fields and interaction strengths) of Ising models from a {\em single} sample. {We evaluate our estimation approach on real networked data, showing that it outperforms standard regression approaches that ignore dependencies, across three text classification datasets: Cora, Citeseer and Pubmed.}

📄 PDF Abstract BibTeX arXiv:2107.09773

Code (0)

등록된 구현이 없습니다.

Tasks

regressiontext-classificationText Classification

Similar Papers 제목 키워드 기반

Information-theoretic lower bounds for distributed statistical estimation with communication constraints

2013-12-01 · NeurIPS 2013 12 · Yuchen Zhang, John Duchi, Michael. I. Jordan, Martin J. Wainwright

We establish minimax risk lower bounds for distributed statistical estimation given a budget $B$ of the total number of bits that may be communicated. Such lower bounds in turn reveal the minimum amount of communication …

Binary ClassificationGeneral Classificationregression

Distributed Estimation in Large Scale Wireless Sensor Networks via a Two Step Group-based Approach

2022-03-17 · Shan Zhang, Pranay Sharma, Baocheng Geng, Pramod K. Varshney

We consider the problem of collaborative distributed estimation in a large scale sensor network with statistically dependent sensor observations. In collaborative setup, the aim is to maximize the overall estimation perf…

High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods

2023-08-27 · Christis Katsouris

These lecture notes provide an overview of existing methodologies and recent developments for estimation and inference with high dimensional time series regression models. First, we present main limit theory results for …

regressionTime SeriesTime Series AnalysisTime Series Regression

SGD with Dependent Data: Optimal Estimation, Regret, and Inference

2026-01-04 · Yinan Shen, Yichen Zhang, Wen-Xin Zhou arxiv

This work investigates the performance of the final iterate produced by stochastic gradient descent (SGD) under temporally dependent data. We consider two complementary sources of dependence: $(i)$ martingale-type depend…

Decision Making

Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequality

2015-06-24 · Mark Braverman, Ankit Garg, Tengyu Ma, Huy L. Nguyen 외

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ ma…