Specification mining and automated task planning for autonomous robots based on a graph-based spatial temporal logic
We aim to enable an autonomous robot to learn new skills from demo videos and use these newly learned skills to accomplish non-trivial high-level tasks. The goal of developing such autonomous robot involves knowledge representation, specification mining, and automated task planning. For knowledge representation, we use a graph-based spatial temporal logic (GSTL) to capture spatial and temporal information of related skills demonstrated by demo videos. We design a specification mining algorithm to generate a set of parametric GSTL formulas from demo videos by inductively constructing spatial terms and temporal formulas. The resulting parametric GSTL formulas from specification mining serve as a domain theory, which is used in automated task planning for autonomous robots. We propose an automatic task planning based on GSTL where a proposer is used to generate ordered actions, and a verifier is used to generate executable task plans. A table setting example is used throughout the paper to illustrate the main ideas.
Code (0)
등록된 구현이 없습니다.
Tasks
Task PlanningSimilar Papers 제목 키워드 기반
Automated Process Planning Based on a Semantic Capability Model and SMT
In research of manufacturing systems and autonomous robots, the term capability is used for a machine-interpretable specification of a system function. Approaches in this research area develop information models that cap…
validFine-Tuning Language Models Using Formal Methods Feedback
Although pre-trained language models encode generic knowledge beneficial for planning and control, they may fail to generate appropriate control policies for domain-specific tasks. Existing fine-tuning methods use human …
Autonomous DrivingSafe Planning through Incremental Decomposition of Signal Temporal Logic Specifications
Trajectory planning is a critical process that enables autonomous systems to safely navigate complex environments. Signal temporal logic (STL) specifications are an effective way to encode complex temporally extended obj…
NavigateSchedulingTrajectory PlanningIntegrating Legal and Logical Specifications in Perception, Prediction, and Planning for Automated Driving: A Survey of Methods
This survey provides an analysis of current methodologies integrating legal and logical specifications into the perception, prediction, and planning modules of automated driving systems. We systematically explore techniq…
Autonomous DrivingLegal ReasoningMulti-tier Automated Planning for Adaptive Behavior (Extended Version)
A planning domain, as any model, is never complete and inevitably makes assumptions on the environment's dynamic. By allowing the specification of just one domain model, the knowledge engineer is only able to make one se…
Fairness