paper-with-me

홈 › Papers

A Neuromorphic Reinforcement Learning Framework for Efficient Pathfinding in Robotic Mobile Fulfillment Systems

2026-06-18 · Junzhe Xu, Zecui Zeng, Lusong Li, Yuetong Fang, Renjing Xu arxiv

Dynamic environmental changes, confined workspaces, and stringent real-time constraints make pathfinding in Robotic Mobile Fulfillment Systems (RMFS) a challenging problem for conventional search- and rule-based methods, which typically suffer from high computational complexity and long decision latency. While reinforcement learning (RL) has emerged as a powerful alternative, deploying learned policies with extreme energy efficiency on resource-constrained hardware remains an open challenge. We present SDQN-RMFS, an end-to-end framework that achieves high-fidelity deployment of an RL-trained policy from a full-precision artificial neural network (ANN) through to a neuromorphic chip. By computing only when triggered by sparse events, this framework unlocks ultra-low-power RMFS pathfinding. Our full-stack pipeline operates as follows: an ANN policy is first efficiently trained via a collision-allowing strategy to densify informative trajectories, and then converted into a spiking neural network (SNN) via a hard-label knowledge distillation approach. This effectively addresses the output distribution mismatch, preserving policy capability across the ANN-to-SNN pipeline while substantially reducing inference latency. Hardware experiments demonstrate up to 11,281$\times$ energy savings and a nearly two-fold reduction in latency compared to a high-performance GPU baseline, while maintaining decision quality on par with the original trained policy. These results establish physical neuromorphic inference as a practical and energy-sustainable pathway for large-scale RMFS operations.

📄 PDF Abstract BibTeX arXiv:2606.20031

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationReinforcement Learning

Similar Papers 제목 키워드 기반

Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware

2020-03-02 · Guangzhi Tang, Neelesh Kumar, Konstantinos P. Michmizos

Energy-efficient mapless navigation is crucial for mobile robots as they explore unknown environments with limited on-board resources. Although the recent deep reinforcement learning (DRL) approaches have been successful…

Deep Reinforcement LearningReinforcement LearningRepresentation Learning

An Astrocyte-Modulated Neuromorphic Central Pattern Generator for Hexapod Robot Locomotion on Intel's Loihi

2020-06-08 · Ioannis Polykretis, Konstantinos P. Michmizos

Locomotion is a crucial challenge for legged robots that is addressed "effortlessly" by biological networks abundant in nature, named central pattern generators (CPG). The multitude of CPG network models that have so far…

Towards Learning Foundation Models for Heuristic Functions to Solve Pathfinding Problems

2024-06-01 · Vedant Khandelwal, Amit Sheth, Forest Agostinelli

Pathfinding problems are found throughout robotics, computational science, and natural sciences. Traditional methods to solve these require training deep neural networks (DNNs) for each new problem domain, consuming subs…

Deep Reinforcement Learning

Quantum Computing and Neuromorphic Computing for Safe, Reliable, and explainable Multi-Agent Reinforcement Learning: Optimal Control in Autonomous Robotics

2024-07-29 · Mazyar Taghavi

This paper investigates the utilization of Quantum Computing and Neuromorphic Computing for Safe, Reliable, and Explainable Multi_Agent Reinforcement Learning (MARL) in the context of optimal control in autonomous roboti…

Multi-agent Reinforcement Learning

Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware

2025-12-03 · Kenneth Stewart, Roxana Leontie, Samantha Chapin, Joe Hays 외 arxiv

We present an end-to-end pipeline for deploying reinforcement learning (RL) trained Artificial Neural Networks (ANNs) on neuromorphic hardware by converting them into spiking Sigma-Delta Neural Networks (SDNNs). We demon…

Reinforcement Learning