paper-with-me

Papers

Online and Offline Robust Multivariate Linear Regression

2024-04-30 · Antoine Godichon-Baggioni, Stephane S. Robin, Laure Sansonnet

We consider the robust estimation of the parameters of multivariate Gaussian linear regression models. To this aim we consider robust version of the usual (Mahalanobis) least-square criterion, with or without Ridge regularization. We introduce two methods each considered contrast: (i) online stochastic gradient descent algorithms and their averaged versions and (ii) offline fix-point algorithms. Under weak assumptions, we prove the asymptotic normality of the resulting estimates. Because the variance matrix of the noise is usually unknown, we propose to plug a robust estimate of it in the Mahalanobis-based stochastic gradient descent algorithms. We show, on synthetic data, the dramatic gain in terms of robustness of the proposed estimates as compared to the classical least-square ones. Well also show the computational efficiency of the online versions of the proposed algorithms. All the proposed algorithms are implemented in the R package RobRegression available on CRAN.

📄 PDF Abstract BibTeX arXiv:2404.19496

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiencyregression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Multivariate Online Linear Regression for Hierarchical Forecasting

2024-02-22 · Massil Hihat, Guillaume Garrigos, Adeline Fermanian, Simon Bussy

In this paper, we consider a deterministic online linear regression model where we allow the responses to be multivariate. To address this problem, we introduce MultiVAW, a method that extends the well-known Vovk-Azoury-…

regression

Synergistic Offline-Online Control Synthesis via Local Gaussian Process Regression

2021-10-11 · John Jackson, Luca Laurenti, Eric Frew, Morteza Lahijanian

Autonomous systems often have complex and possibly unknown dynamics due to, e.g., black-box components. This leads to unpredictable behaviors and makes control design with performance guarantees a major challenge. This p…

regression

OLR-WA: Online Weighted Average Linear Regression in Multivariate Data Streams

2025-12-16 · Mohammad Abu-Shaira, Alejandro Rodriguez, Greg Speegle, Victor Sheng 외 arxiv

Online learning updates models incrementally with new data, avoiding large storage requirements and costly model recalculations. In this paper, we introduce "OLR-WA; OnLine Regression with Weighted Average", a novel and …

Conditional independence testing with a single realization of a multivariate nonstationary nonlinear time series

2025-04-30 · Michael Wieck-Sosa, Michel F. C. Haddad, Aaditya Ramdas

Identifying relationships among stochastic processes is a key goal in disciplines that deal with complex temporal systems, such as economics. While the standard toolkit for multivariate time series analysis has many adva…

Causal DiscoveryTime SeriesTime Series AnalysisVariable Selection

Scalable Matrix-valued Kernel Learning for High-dimensional Nonlinear Multivariate Regression and Granger Causality

2014-08-09 · Vikas Sindhwani, Ha Quang Minh, Aurelie Lozano

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that …

Causal InferenceGeneralization Boundsregression