Non-convex Statistical Optimization for Sparse Tensor Graphical Model

2015-12-01 · NeurIPS 2015 12 · Wei Sun, Zhaoran Wang, Han Liu, Guang Cheng

We consider the estimation of sparse graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we assume the data follow a tensor normal distribution whose covariance has a Kronecker product structure. The penalized maximum likelihood estimation of this model involves minimizing a non-convex objective function. In spite of the non-convexity of this estimation problem, we prove that an alternating minimization algorithm, which iteratively estimates each sparse precision matrix while fixing the others, attains an estimator with the optimal statistical rate of convergence as well as consistent graph recovery. Notably, such an estimator achieves estimation consistency with only one tensor sample, which is unobserved in previous work. Our theoretical results are backed by thorough numerical studies.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tensor Graphical Model: Non-convex Optimization and Statistical Inference

2016-09-15 · Xiang Lyu, Will Wei Sun, Zhaoran Wang, Han Liu 외

We consider the estimation and inference of graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each w…

Sparse Tensor Additive Regression

2019-03-31 · Botao Hao, Boxiang Wang, Pengyuan Wang, Jingfei Zhang 외

Tensors are becoming prevalent in modern applications such as medical imaging and digital marketing. In this paper, we propose a sparse tensor additive regression (STAR) that models a scalar response as a flexible nonpar…

Click-Through Rate Prediction Marketing parameter estimation regression

Sparse and Low-rank Tensor Estimation via Cubic Sketchings

2018-01-29 · Botao Hao, Anru Zhang, Guang Cheng

In this paper, we propose a general framework for sparse and low-rank tensor estimation from cubic sketchings. A two-stage non-convex implementation is developed based on sparse tensor decomposition and thresholded gradi…

regression Tensor Decomposition

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimization

2017-12-01 · NeurIPS 2017 12 · Pan Xu, Jian Ma, Quanquan Gu

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the spars…

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimizations

2017-02-28 · NeurIPS 2017 · Pan Xu, Jian Ma, Quanquan Gu