paper-with-me

홈 › Papers

Regression from Dependent Observations

2019-05-08 · Constantinos Daskalakis, Nishanth Dikkala, Ioannis Panageas

The standard linear and logistic regression models assume that the response variables are independent, but share the same linear relationship to their corresponding vectors of covariates. The assumption that the response variables are independent is, however, too strong. In many applications, these responses are collected on nodes of a network, or some spatial or temporal domain, and are dependent. Examples abound in financial and meteorological applications, and dependencies naturally arise in social networks through peer effects. Regression with dependent responses has thus received a lot of attention in the Statistics and Economics literature, but there are no strong consistency results unless multiple independent samples of the vectors of dependent responses can be collected from these models. We present computationally and statistically efficient methods for linear and logistic regression models when the response variables are dependent on a network. Given one sample from a networked linear or logistic regression model and under mild assumptions, we prove strong consistency results for recovering the vector of coefficients and the strength of the dependencies, recovering the rates of standard regression under independent observations. We use projected gradient descent on the negative log-likelihood, or negative log-pseudolikelihood, and establish their strong convexity and consistency using concentration of measure for dependent random variables.

📄 PDF Abstract BibTeX arXiv:1905.03353

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Model selection for high-dimensional linear regression with dependent observations

2019-06-18 · Ching-Kang Ing

We investigate the prediction capability of the orthogonal greedy algorithm (OGA) in high-dimensional regression models with dependent observations. The rates of convergence of the prediction error of OGA are obtained un…

Model SelectionPredictionregressionVocal Bursts Intensity Prediction

Statistical Estimation from Dependent Data

2021-07-20 · Yuval Dagan, Constantinos Daskalakis, Nishanth Dikkala, Surbhi Goel 외

We consider a general statistical estimation problem wherein binary labels across different observations are not independent conditioned on their feature vectors, but dependent, capturing settings where e.g. these observ…

regressiontext-classificationText Classification

Performance of Empirical Risk Minimization for Linear Regression with Dependent Data

2021-04-25 · Christian Brownlees, Guðmundur Stefán Guðmundsson

This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis …

regression

Adaptive deep nonparametric regression from dependent data under covariate shift

2026-07-22 · William Kengne, Ehud Mossa Ockegna arxiv

Covariate shift often occurs because, in many real applications, the source and the target observations may be generated from different distributions. In this case, the standard metric under the source distribution is no…

Regularized Modal Regression on Markov-dependent Observations: A Theoretical Assessment

2021-12-09 · Tielang Gong, Yuxin Dong, Hong Chen, Bo Dong 외

Modal regression, a widely used regression protocol, has been extensively investigated in statistical and machine learning communities due to its robustness to outliers and heavy-tailed noises. Understanding modal regres…

Learning Theoryregression