Independently Controllable Features
Finding features that disentangle the different causes of variation in real data is a difficult task, that has nonetheless received considerable attention in static domains like natural images. Interactive environments, in which an agent can deliberately take actions, offer an opportunity to tackle this task better, because the agent can experiment with different actions and observe their effects. We introduce the idea that in interactive environments, latent factors that control the variation in observed data can be identified by figuring out what the agent can control. We propose a naive method to find factors that explain or measure the effect of the actions of a learner, and test it in illustrative experiments.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Independently Controllable Factors
It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve t…
Open-Ended Question AnsweringDisentangling the independently controllable factors of variation by interacting with the world
It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve t…
Open-Ended Question AnsweringGIRAFFE HD: A High-Resolution 3D-aware Generative Model
3D-aware generative models have shown that the introduction of 3D information can lead to more controllable image generation. In particular, the current state-of-the-art model GIRAFFE can control each object's rotation, …
DisentanglementImage GenerationTranslationVocal Bursts Intensity PredictionDisentangling Controllable and Uncontrollable Factors of Variation by Interacting with the World
We introduce a method to disentangle controllable and uncontrollable factors of variation by interacting with the world. Disentanglement leads to good representations and is important when applying deep neural networks (…
Disentanglementreinforcement-learningReinforcement LearningReinforcement Learning (RL)From Pixels to Factors: Learning Independently Controllable State Variables for Reinforcement Learning
Algorithms that exploit factored Markov decision processes are far more sample-efficient than factor-agnostic methods, yet they assume a factored representation is known a priori -- a requirement that breaks down when th…
Reinforcement LearningContrastive Learning