Riemannian Optimization for Variance Estimation in Linear Mixed Models
Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on parameter estimation in linear mixed models by exploiting the intrinsic geometry of the parameter space. We formulate the problem of residual maximum likelihood estimation as an optimization problem on a Riemannian manifold. Based on the introduced formulation, we give geometric higher-order information on the problem via the Riemannian gradient and the Riemannian Hessian. Based on that, we test our approach with Riemannian optimization algorithms numerically. Our approach yields a higher quality of the variance parameter estimates compared to existing approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
parameter estimationRiemannian optimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Intrinsic Riemannian Cross-covariance for Manifold-valued Random Objects
Covariance estimation yields a fundamental second-order statistic underlying representation learning, dimension reduction, and dependence modeling. While covariance has been well understood in Euclidean spaces, it is ill…
Representation LearningAn efficient Exact-PGA algorithm for constant curvature manifolds
Manifold-valued datasets are widely encountered in many computer vision tasks. A non-linear analog of the PCA, called the Principal Geodesic Analysis (PGA) suited for data lying on Riemannian manifolds was reported in li…
Low-complexity subspace-descent over symmetric positive definite manifold
This work puts forth low-complexity Riemannian subspace descent algorithms for the minimization of functions over the symmetric positive definite (SPD) manifold. Different from the existing Riemannian gradient descent va…
parameter estimationRiemannian optimizationRiemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds
We study optimization of finite sums of geodesically smooth functions on Riemannian manifolds. Although variance reduction techniques for optimizing finite-sums have witnessed tremendous attention in the recent years, ex…
Riemannian optimizationStochastic OptimizationMonocular Object Orientation Estimation using Riemannian Regression and Classification Networks
We consider the task of estimating the 3D orientation of an object of known category given an image of the object and a bounding box around it. Recently, CNN-based regression and classification methods have shown signifi…
ClassificationData AugmentationGeneral Classificationregression