Model based Multi-agent Reinforcement Learning with Tensor Decompositions

2021-10-27 · Pascal Van Der Vaart, Anuj Mahajan, Shimon Whiteson

A challenge in multi-agent reinforcement learning is to be able to generalize over intractable state-action spaces. Inspired from Tesseract [Mahajan et al., 2021], this position paper investigates generalisation in state-action space over unexplored state-action pairs by modelling the transition and reward functions as tensors of low CP-rank. Initial experiments on synthetic MDPs show that using tensor decompositions in a model-based reinforcement learning algorithm can lead to much faster convergence if the true transition and reward functions are indeed of low rank.

📄 PDF Abstract BibTeX arXiv:2110.14524

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement LearningMulti-agent Reinforcement LearningPositionreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning in Factored Action Spaces using Tensor Decompositions

2021-10-27 · Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk 외

We present an extended abstract for the previously published work TESSERACT [Mahajan et al., 2021], which proposes a novel solution for Reinforcement Learning (RL) in large, factored action spaces using tensor decomposit…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Tensor Decompositions: A New Concept in Brain Data Analysis?

2013-05-02 · Andrzej Cichocki

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component …

blind source separation Classification Clustering Dimensionality Reduction+2

Mode-wise Tensor Decompositions: Multi-dimensional Generalizations of CUR Decompositions

2021-03-19 · HanQin Cai, Keaton Hamm, Longxiu Huang, Deanna Needell

Low rank tensor approximation is a fundamental tool in modern machine learning and data science. In this paper, we study the characterization, perturbation analysis, and an efficient sampling strategy for two primary ten…

Tensor Decompositions in Deep Learning

2020-02-26 · Davide Bacciu, Danilo P. Mandic

The paper surveys the topic of tensor decompositions in modern machine learning applications. It focuses on three active research topics of significant relevance for the community. After a brief review of consolidated wo…

BIG-bench Machine Learning Deep Learning

Discovering faster matrix multiplication algorithms with reinforcement learning

2022-10-05 · Nature 2022 10 · Alhussein Fawzi, Matej Balog, Aja Huang, Thomas Hubert 외

Improving the efficiency of algorithms for fundamental computations can have a widespread impact, as it can affect the overall speed of a large amount of computations. Matrix multiplication is one such primitive task, oc…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)