paper-with-me

Papers

Learning intuitive physics and one-shot imitation using state-action-prediction self-organizing maps

2020-07-03 · Martin Stetter, Elmar W. Lang

Human learning and intelligence work differently from the supervised pattern recognition approach adopted in most deep learning architectures. Humans seem to learn rich representations by exploration and imitation, build causal models of the world, and use both to flexibly solve new tasks. We suggest a simple but effective unsupervised model which develops such characteristics. The agent learns to represent the dynamical physical properties of its environment by intrinsically motivated exploration, and performs inference on this representation to reach goals. For this, a set of self-organizing maps which represent state-action pairs is combined with a causal model for sequence prediction. The proposed system is evaluated in the cartpole environment. After an initial phase of playful exploration, the agent can execute kinematic simulations of the environment's future, and use those for action planning. We demonstrate its performance on a set of several related, but different one-shot imitation tasks, which the agent flexibly solves in an active inference style.

📄 PDF Abstract BibTeX arXiv:2007.01647

Code (1)

martinstetter/sapsom 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Visual cognition in multimodal large language models

2023-11-27 · Luca M. Schulze Buschoff, Elif Akata, Matthias Bethge, Eric Schulz

A chief goal of artificial intelligence is to build machines that think like people. Yet it has been argued that deep neural network architectures fail to accomplish this. Researchers have asserted these models' limitati…

A Neural-Symbolic Framework for Mental Simulation

2020-08-05 · Michael Kissner

We present a neural-symbolic framework for observing the environment and continuously learning visual semantics and intuitive physics to reproduce them in an interactive simulation. The framework consists of five parts, …

Meta-Learning

Occlusion resistant learning of intuitive physics from videos

2020-04-30 · Ronan Riochet, Josef Sivic, Ivan Laptev, Emmanuel Dupoux

To reach human performance on complex tasks, a key ability for artificial systems is to understand physical interactions between objects, and predict future outcomes of a situation. This ability, often referred to as int…

Object

GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Reality

2025-10-13 · Anastasiya Pechko, Piotr Borycki, Joanna Waczyńska, Daniel Barczyk 외 arxiv

As the demand for immersive 3D content grows, the need for intuitive and efficient interaction methods becomes paramount. Current techniques for physically manipulating 3D content within Virtual Reality (VR) often face s…

Intrinsic Motivation Driven Intuitive Physics Learning using Deep Reinforcement Learning with Intrinsic Reward Normalization

2019-07-06 · JaeWon Choi, Sung-Eui Yoon

At an early age, human infants are able to learn and build a model of the world very quickly by constantly observing and interacting with objects around them. One of the most fundamental intuitions human infants acquire …

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)