paper-with-me

홈 › Papers

Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics

2025-05-03 · Jesse Barkley, Abraham George, Amir Barati Farimani

Classical robot navigation often relies on hardcoded state machines and purely geometric path planners, limiting a robot's ability to interpret high-level semantic instructions. In this paper, we first assess GPT-4's ability to act as a path planner compared to the A* algorithm, then present a hybrid planning framework that integrates GPT-4's semantic reasoning with A* on a low-cost robot platform operating on ROS2 Humble. Our approach eliminates explicit finite state machine (FSM) coding by using prompt-based GPT-4 reasoning to handle task logic while maintaining the accurate paths computed by A*. The GPT-4 module provides semantic understanding of instructions and environmental cues (e.g., recognizing toxic obstacles or crowded areas to avoid, or understanding low-battery situations requiring alternate route selection), and dynamically adjusts the robot's occupancy grid via obstacle buffering to enforce semantic constraints. We demonstrate multi-step reasoning for sequential tasks, such as first navigating to a resource goal and then reaching a final destination safely. Experiments on a Petoi Bittle robot with an overhead camera and Raspberry Pi Zero 2W compare classical A* against GPT-4-assisted planning. Results show that while A* is faster and more accurate for basic route generation and obstacle avoidance, the GPT-4-integrated system achieves high success rates (96-100%) on semantic tasks that are infeasible for pure geometric planners. This work highlights how affordable robots can exhibit intelligent, context-aware behaviors by leveraging large language model reasoning with minimal hardware and no fine-tuning.

📄 PDF Abstract BibTeX arXiv:2505.01931

Code (0)

등록된 구현이 없습니다.

Tasks

Large Language ModelRobot Navigation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Online Learning and Planning in Cognitive Hierarchies

2023-10-18 · Bernhard Hengst, Maurice Pagnucco, David Rajaratnam, Claude Sammut 외

Complex robot behaviour typically requires the integration of multiple robotic and Artificial Intelligence (AI) techniques and components. Integrating such disparate components into a coherent system, while also ensuring…

GEM: Generative Supervision Helps Embodied Intelligence

2026-05-27 · Ruowen Zhao, Bangguo Li, Zuyan Liu, Yinan Liang 외 arxiv

Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-l…

FogROS2-FT: Fault Tolerant Cloud Robotics

2024-12-06 · Kaiyuan Chen, Kush Hari, Trinity Chung, Michael Wang 외

Cloud robotics enables robots to offload complex computational tasks to cloud servers for performance and ease of management. However, cloud compute can be costly, cloud services can suffer occasional downtime, and conne…

Cloud ComputingMotion Planningobject-detectionObject Detection+1

A Tutorial on World Models and Physical AI

2026-06-11 · Il-Seok Oh arxiv

World modeling is emerging as a central principle for building intelligent systems capable of prediction, reasoning, and decision making. A central distinction can be drawn between explicit world models, which learn stru…

Autonomous DrivingDecision Making

SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning

2023-07-12 · Krishan Rana, Jesse Haviland, Sourav Garg, Jad Abou-Chakra 외

Large language models (LLMs) have demonstrated impressive results in developing generalist planning agents for diverse tasks. However, grounding these plans in expansive, multi-floor, and multi-room environments presents…

Robot Task PlanningTask Planning