paper-with-me

Papers

Grid Cell-Inspired Fragmentation and Recall for Efficient Map Building

2023-07-11 · Jaedong Hwang, Zhang-Wei Hong, Eric Chen, Akhilan Boopathy, Pulkit Agrawal, Ila Fiete

Animals and robots navigate through environments by building and refining maps of space. These maps enable functions including navigation back to home, planning, search and foraging. Here, we use observations from neuroscience, specifically the observed fragmentation of grid cell map in compartmentalized spaces, to propose and apply the concept of Fragmentation-and-Recall (FARMap) in the mapping of large spaces. Agents solve the mapping problem by building local maps via a surprisal-based clustering of space, which they use to set subgoals for spatial exploration. Agents build and use a local map to predict their observations; high surprisal leads to a "fragmentation event" that truncates the local map. At these events, the recent local map is placed into long-term memory (LTM) and a different local map is initialized. If observations at a fracture point match observations in one of the stored local maps, that map is recalled (and thus reused) from LTM. The fragmentation points induce a natural online clustering of the larger space, forming a set of intrinsic potential subgoals that are stored in LTM as a topological graph. Agents choose their next subgoal from the set of near and far potential subgoals from within the current local map or LTM, respectively. Thus, local maps guide exploration locally, while LTM promotes global exploration. We demonstrate that FARMap replicates the fragmentation points observed in animal studies. We evaluate FARMap on complex procedurally-generated spatial environments and realistic simulations to demonstrate that this mapping strategy much more rapidly covers the environment (number of agent steps and wall clock time) and is more efficient in active memory usage, without loss of performance. https://jd730.github.io/projects/FARMap/

📄 PDF Abstract BibTeX arXiv:2307.05793

Code (1)

fietelab/farmap 공식 구현 pytorch

Tasks

ClusteringNavigateOnline Clustering

Methods 이 논문이 사용한 방법론

Fragmentation Given a pattern $P,$ that is more complicated than the patterns, we fragment $P$ into simpler patterns such that their exact count is known. In the subgraph GNN proposed earlier,…

Similar Papers 제목 키워드 기반

Neuro-Inspired Fragmentation and Recall to Overcome Catastrophic Forgetting in Curiosity

2023-10-26 · Jaedong Hwang, Zhang-Wei Hong, Eric Chen, Akhilan Boopathy 외

Deep reinforcement learning methods exhibit impressive performance on a range of tasks but still struggle on hard exploration tasks in large environments with sparse rewards. To address this, intrinsic rewards can be gen…

Deep Reinforcement LearningPrediction

Are Grid Cells Hexagonal for Performance or by Convenience?

2024-10-11 · Taahaa Mir, Peipei Yao, Kateri Duranceau, Isabeau Prémont-Schwarz

This paper investigates whether the hexagonal structure of grid cells provides any performance benefits or if it merely represents a biologically convenient configuration. Utilizing the Vector-HaSH content addressable me…

REMI: Reconstructing Episodic Memory During Internally Driven Path Planning

2025-07-02 · Zhaoze Wang, Genela Morris, Dori Derdikman, Pratik Chaudhari 외 arxiv

Grid cells in the medial entorhinal cortex (MEC) and place cells in the hippocampus (HC) both form spatial representations. Grid cells fire in triangular grid patterns, while place cells fire at specific locations and re…

PaceLLM: Brain-Inspired Large Language Models for Long-Context Understanding

2025-06-18 · Kangcong Li, Peng Ye, Chongjun Tu, Lin Zhang 외

While Large Language Models (LLMs) demonstrate strong performance across domains, their long-context capabilities are limited by transient neural activations causing information decay and unstructured feed-forward networ…

Long-Context Understanding

GridPE: Unifying Positional Encoding in Transformers with a Grid Cell-Inspired Framework

2024-06-11 · Boyang Li, Yulin Wu, Nuoxian Huang, Wenjia Zhang

Understanding spatial location and relationships is a fundamental capability for modern artificial intelligence systems. Insights from human spatial cognition provide valuable guidance in this domain. Neuroscientific dis…