Logically Constrained Robotics Transformers for Enhanced Perception-Action Planning
With the advent of large foundation model based planning, there is a dire need to ensure their output aligns with the stakeholder's intent. When these models are deployed in the real world, the need for alignment is magnified due to the potential cost to life and infrastructure due to unexpected faliures. Temporal Logic specifications have long provided a way to constrain system behaviors and are a natural fit for these use cases. In this work, we propose a novel approach to factor in signal temporal logic specifications while using autoregressive transformer models for trajectory planning. We also provide a trajectory dataset for pretraining and evaluating foundation models. Our proposed technique acheives 74.3 % higher specification satisfaction over the baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Trajectory PlanningSimilar Papers 제목 키워드 기반
Advances in Transformers for Robotic Applications: A Review
The introduction of Transformers architecture has brought about significant breakthroughs in Deep Learning (DL), particularly within Natural Language Processing (NLP). Since their inception, Transformers have outperforme…
Decision MakingDeep Reinforcement LearningDouble-Helix Vision (DH-V2): A Geometry-Based Visual Sampler for Bandwidth-Constrained Perception
We present Double-Helix Vision (DH), a geometry-based visual sampler that compresses 2D images into compact 1D signals using paired golden-ratio-inspired spiral trajectories. Rather than processing every pixel uniformly,…
Disparity EstimationRecti-Q: Feature-Space Rectification for Out-of-Distribution-Robust Quantized Perception in Edge Robotics
Robotic perception pipelines increasingly rely on large vision backbones deployed on SWaP-constrained edge platforms, making post-training quantization (PTQ) attractive for real-time inference. However, while PTQ often p…
FieldNet: Efficient Real-Time Shadow Removal for Enhanced Vision in Field Robotics
Shadows significantly hinder computer vision tasks in outdoor environments, particularly in field robotics, where varying lighting conditions complicate object detection and localisation. We present FieldNet, a novel dee…
Edge-computingobject-detectionObject DetectionShadow Removal+1Geometric PID Controller for Stabilization of Nonholonomic Mechanical Systems on Lie Groups
The PID controller is an elegant and versatile controller for set point tracking in double integrator systems of which mechanical systems evolving on Euclidean space constitute a large class. But since mechanical systems…
Point Tracking