Learning deep dynamical models from image pixels

2014-10-28 · Niklas Wahlström, Thomas B. Schön, Marc Peter Deisenroth

Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement mapping and the transition mapping (system dynamics) in latent space can be challenging. For linear system dynamics and measurement mappings efficient solutions for system identification are available. However, in practical applications, the linearity assumptions does not hold, requiring non-linear system identification techniques. If additionally the observations are high-dimensional (e.g., images), non-linear system identification is inherently hard. To address the problem of non-linear system identification from high-dimensional observations, we combine recent advances in deep learning and system identification. In particular, we jointly learn a low-dimensional embedding of the observation by means of deep auto-encoders and a predictive transition model in this low-dimensional space. We demonstrate that our model enables learning good predictive models of dynamical systems from pixel information only.

📄 PDF Abstract BibTeX arXiv:1410.7550

Code (0)

등록된 구현이 없습니다.

Peekaboo - Where are the Objects? Structure Adjusting Superpixels

2018-02-08 · Georg Maierhofer, Daniel Heydecker, Angelica I. Aviles-Rivero, Samar M. Alsaleh 외

This paper addresses the search for a fast and meaningful image segmentation in the context of $k$-means clustering. The proposed method builds on a widely-used local version of Lloyd's algorithm, called Simple Linear It…

Clustering Image Segmentation Semantic Segmentation Superpixels

SAWU-Net: Spatial Attention Weighted Unmixing Network for Hyperspectral Images

2023-04-22 · Lin Qi, Xuewen Qin, Feng Gao, Junyu Dong 외

Hyperspectral unmixing is a critical yet challenging task in hyperspectral image interpretation. Recently, great efforts have been made to solve the hyperspectral unmixing task via deep autoencoders. However, existing ne…

Hyperspectral Unmixing

Data-Efficient Learning of Feedback Policies from Image Pixels using Deep Dynamical Models

2015-10-08 · John-Alexander M. Assael, Niklas Wahlström, Thomas B. Schön, Marc Peter Deisenroth

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important i…

Model-based Reinforcement Learning Model Predictive Control reinforcement-learning Reinforcement Learning+1

From Pixels to Torques: Policy Learning with Deep Dynamical Models

2015-02-08 · Niklas Wahlström, Thomas B. Schön, Marc Peter Deisenroth

Data-efficient learning in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. In this paper, we consider one instance of this challenge…

Model-based Reinforcement Learning Model Predictive Control reinforcement-learning Reinforcement Learning+1

Magnifying Networks for Images with Billions of Pixels

2021-12-12 · Neofytos Dimitriou, Ognjen Arandjelovic

The shift towards end-to-end deep learning has brought unprecedented advances in many areas of computer vision. However, deep neural networks are trained on images with resolutions that rarely exceed $1,000 \times 1,000$…

image-classification Image Classification Medical Diagnosis