End-to-end Sketch-Guided Path Planning through Imitation Learning for Autonomous Mobile Robots
Path planning is crucial for Autonomous Mobile Robots applications. Traditionally, path planning based on human input and preferences has relied on hard to define reward-based learning or costly techniques requiring additional hardware. This work introduces a more accessible and flexible approach through sketch-guided imitation learning, where nontechnical users can simply draw the desired navigational path on a provided 2D map, which is then used to teach U-net models path planning behaviors. Additionally, the work draws on metrics from the fields of image generation and robotics to provide a novel evaluation framework. The approach is integrated into an end-to-end robotics stack to demonstrate its usability. The dataset and code are provided on https://github.com/charbel-a-hC/SKIPP.
Code (1)
Tasks
Image GenerationImitation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SPADE: Sketch-guided Path Planning Augmented with Diffusion Experts
Path planning is essential for Autonomous Mobile Robots (AMRs). Conventional methods for incorporating human preferences into planning typically rely on either complex reward engineering or hardware-intensive solutions. …
Learning Sketch Decompositions in Planning via Deep Reinforcement Learning
In planning and reinforcement learning, the identification of common subgoal structures across problems is important when goals are to be achieved over long horizons. Recently, it has been shown that such structures can …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningSketchPlan: Diffusion Based Drone Planning From Human Sketches
We propose SketchPlan, a diffusion-based planner that interprets 2D hand-drawn sketches over depth images to generate 3D flight paths for drone navigation. SketchPlan comprises two components: a SketchAdapter that learns…
Drone navigationPRoH: Dynamic Planning and Reasoning over Knowledge Hypergraphs for Retrieval-Augmented Generation
Knowledge Hypergraphs (KHs) have recently emerged as a knowledge representation for retrieval-augmented generation (RAG), offering a paradigm to model multi-entity relations into a structured form. However, existing KH-b…
Multi-hop Question AnsweringFM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation
Path planning is a critical component in autonomous drone operations, enabling safe and efficient navigation through complex environments. Recent advances in foundation models, particularly large language models (LLMs) a…
BenchmarkingDecision MakingDrone navigation