Bayesian Optimization Meets Riemannian Manifolds in Robot Learning
Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its performance may be seriously compromised when the parameter space is high-dimensional. A way to tackle this problem is to introduce domain knowledge into the BO framework. We propose to exploit the geometry of non-Euclidean parameter spaces, which often arise in robotics (e.g. orientation, stiffness matrix). Our approach, built on Riemannian manifold theory, allows BO to properly measure similarities in the parameter space through geometry-aware kernel functions and to optimize the acquisition function on the manifold as an unconstrained problem. We test our approach in several benchmark artificial landscapes and using a 7-DOF simulated robot to learn orientation and impedance parameters for manipulation skills.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationReinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Geometry-aware Bayesian Optimization in Robotics using Riemannian Matérn Kernels
Bayesian optimization is a data-efficient technique which can be used for control parameter tuning, parametric policy adaptation, and structure design in robotics. Many of these problems require optimization of functions…
Bayesian OptimizationMotion PlanningGaussians on Riemannian Manifolds: Applications for Robot Learning and Adaptive Control
This article presents an overview of robot learning and adaptive control applications that can benefit from a joint use of Riemannian geometry and probabilistic representations. The roles of Riemannian manifolds, geodesi…
ClusteringregressionBayesian Quadrature on Riemannian Data Manifolds
Riemannian manifolds provide a principled way to model nonlinear geometric structure inherent in data. A Riemannian metric on said manifolds determines geometry-aware shortest paths and provides the means to define stati…
Riemannian Stein Variational Gradient Descent for Bayesian Inference
We develop Riemannian Stein Variational Gradient Descent (RSVGD), a Bayesian inference method that generalizes Stein Variational Gradient Descent (SVGD) to Riemann manifold. The benefits are two-folds: (i) for inference …
Bayesian InferenceFoundations of Riemannian Geometry for Riemannian Optimization: A Monograph with Detailed Derivations
Riemannian geometry provides the fundamental framework for optimization on nonlinear spaces such as matrix manifolds, which arise in machine learning, signal processing, and robotics. While the underlying theory is class…