paper-with-me

홈 › Papers

Robust Tensor Regression with Nonconvexity: Algorithmic and Statistical Theory

2026-05-08 · Zihao Song, Jicai Liu, Heng Lian, Weihua Zhao arxiv

Tensor regression is an important tool for tensor data analysis, but existing works have not considered the impact of outliers, making them potentially sensitive to such data points. This paper proposes a low tubal rank robust regression method for analyzing high-dimensional tensor data with heavy-tailed random noise. The proposed method is based on a nonconvex relaxation of the tensor tubal rank within a general optimization framework, which allows for nonconvexity in both the loss and penalty functions. We develop an implementable estimation algorithm and establish its global convergence under some mild assumptions. Furthermore, we provide general statistical theories regarding stationary point, including the rates of convergence and bounds on the prediction error. These theoretical results cover many important models, such as linear models, generalized linear models, and Huber regression, and even encompass some nonconvex losses like correntropy and minimum distance criterion-induced losses. Supportive numerical evidence is provided through simulations and application studies.

📄 PDF Abstract BibTeX arXiv:2605.07448

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima

2013-05-10 · NeurIPS 2013 12 · Po-Ling Loh, Martin J. Wainwright

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regulari…

Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay

2022-06-17 · Yuetian Luo, Anru R. Zhang

We study the tensor-on-tensor regression, where the goal is to connect tensor responses to tensor covariates with a low Tucker rank parameter tensor/matrix without the prior knowledge of its intrinsic rank. We propose th…

regressionRiemannian optimization

Perfect reconstruction of sparse signals with piecewise continuous nonconvex penalties and nonconvexity control

2019-02-20 · Ayaka Sakata, Tomoyuki Obuchi

We consider compressed sensing formulated as a minimization problem of nonconvex sparse penalties, Smoothly Clipped Absolute deviation (SCAD) and Minimax Concave Penalty (MCP). The nonconvexity of these penalties is cont…

compressed sensing

Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition

2024-06-10 · Zhen Qin, Zhihui Zhu

Recently, a tensor-on-tensor (ToT) regression model has been proposed to generalize tensor recovery, encompassing scenarios like scalar-on-tensor regression and tensor-on-vector regression. However, the exponential growt…

Computational Efficiencyregression

Sparse Nonlinear Regression: Parameter Estimation and Asymptotic Inference

2015-11-14 · Zhuoran Yang, Zhaoran Wang, Han Liu, Yonina C. Eldar 외

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*…

parameter estimationregressionvalid