paper-with-me

홈 › Papers

Design Principles of the Hippocampal Cognitive Map

2014-12-01 · NeurIPS 2014 12 · Kimberly L. Stachenfeld, Matthew Botvinick, Samuel J. Gershman

Hippocampal place fields have been shown to reflect behaviorally relevant aspects of space. For instance, place fields tend to be skewed along commonly traveled directions, they cluster around rewarded locations, and they are constrained by the geometric structure of the environment. We hypothesize a set of design principles for the hippocampal cognitive map that explain how place fields represent space in a way that facilitates navigation and reinforcement learning. In particular, we suggest that place fields encode not just information about the current location, but also predictions about future locations under the current transition distribution. Under this model, a variety of place field phenomena arise naturally from the structure of rewards, barriers, and directional biases as reflected in the transition policy. Furthermore, we demonstrate that this representation of space can support efficient reinforcement learning. We also propose that grid cells compute the eigendecomposition of place fields in part because is useful for segmenting an enclosure along natural boundaries. When applied recursively, this segmentation can be used to discover a hierarchical decomposition of space. Thus, grid cells might be involved in computing subgoals for hierarchical reinforcement learning.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

How to build a cognitive map: insights from models of the hippocampal formation

2022-02-03 · James C. R. Whittington, David McCaffary, Jacob J. W. Bakermans, Timothy E. J. Behrens

Learning and interpreting the structure of the environment is an innate feature of biological systems, and is integral to guiding flexible behaviours for evolutionary viability. The concept of a cognitive map has emerged…

Hippocampus

Could a Computer Architect Understand our Brain?

2024-05-21 · Valentin Puente-Varona

This paper presents a highly speculative model encompassing the cortex, thalamus, and hippocampus of the mammalian brain. While the majority of computational neuroscience models are founded upon empirical evidence, this …

DescriptiveERPHippocampusspeech-recognition+1

Binding in hippocampal-entorhinal circuits enables compositionality in cognitive maps

2024-06-27 · Christopher J. Kymn, Sonia Mazelet, Anthony Thomas, Denis Kleyko 외

We propose a normative model for spatial representation in the hippocampal formation that combines optimality principles, such as maximizing coding range and spatial information per neuron, with an algebraic framework fo…

HippocampusPosition

An automated, geometry-based method for hippocampal shape and thickness analysis

2023-02-01 · Kersten Diers, Hannah Baumeister, Frank Jessen, Emrah Düzel 외

The hippocampus is one of the most studied neuroanatomical structures due to its involvement in attention, learning, and memory as well as its atrophy in ageing, neurological, and psychiatric diseases. Hippocampal shape …

HippocampusImage Registration

A Surface-Based Federated Chow Test Model for Integrating APOE Status, Tau Deposition Measure, and Hippocampal Surface Morphometry

2023-03-31 · Jianfeng Wu, Yi Su, Yanxi Chen, Wenhui Zhu 외

Background: Alzheimer's Disease (AD) is the most common type of age-related dementia, affecting 6.2 million people aged 65 or older according to CDC data. It is commonly agreed that discovering an effective AD diagnosis …