paper-with-me

Papers

Enhancing Reliability in LLM-Integrated Robotic Systems: A Unified Approach to Security and Safety

2025-09-02 · Wenxiao Zhang, Xiangrui Kong, Conan Dewitt, Thomas Bräunl, Jin B. Hong arxiv

Integrating large language models (LLMs) into robotic systems has revolutionised embodied artificial intelligence, enabling advanced decision-making and adaptability. However, ensuring reliability, encompassing both security against adversarial attacks and safety in complex environments, remains a critical challenge. To address this, we propose a unified framework that mitigates prompt injection attacks while enforcing operational safety through robust validation mechanisms. Our approach combines prompt assembling, state management, and safety validation, evaluated using both performance and security metrics. Experiments show a 30.8% improvement under injection attacks and up to a 325% improvement in complex environment settings under adversarial conditions compared to baseline scenarios. This work bridges the gap between safety and security in LLM-based robotic systems, offering actionable insights for deploying reliable LLM-integrated mobile robots in real-world settings. The framework is open-sourced with simulation and physical deployment demos at https://llmeyesim.vercel.app/

📄 PDF Abstract BibTeX arXiv:2509.02163

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Study on Prompt Injection Attack Against LLM-Integrated Mobile Robotic Systems

2024-08-07 · Wenxiao Zhang, Xiangrui Kong, Conan Dewitt, Thomas Braunl 외

The integration of Large Language Models (LLMs) like GPT-4o into robotic systems represents a significant advancement in embodied artificial intelligence. These models can process multi-modal prompts, enabling them to ge…

Synchronized Online Friction Estimation and Adaptive Grasp Control for Robust Gentle Grasp

2026-02-02 · Zhenwei Niu, Xiaoyi Chen, Jiayu Hu, Zhaoyang Liu 외 arxiv

We introduce a unified framework for gentle robotic grasping that synergistically couples real-time friction estimation with adaptive grasp control. We propose a new particle filter-based method for real-time estimation …

Robotic Grasping

Reliability-aware Execution Gating for Near-field and Off-axis Vision-guided Robotic Alignment

2026-02-09 · Ning Hu, Senhao Cao, Maochen Li arxiv

Vision-guided robotic systems are increasingly deployed in precision alignment tasks that require reliable execution under near-field and off-axis configurations. While recent advances in pose estimation have significant…

Pose Estimation

Robustness Enhancement of Object Detection in Advanced Driver Assistance Systems (ADAS)

2021-05-04 · Le-Anh Tran, Truong-Dong Do, Dong-Chul Park, My-Ha Le

A unified system integrating a compact object detector and a surrounding environmental condition classifier for enhancing the robustness of object detection scheme in advanced driver assistance systems (ADAS) is proposed…

Autonomous DrivingObjectobject-detectionObject Detection

Neural Minimum-Distance Estimation for Collision-Aware Operation of Multi-Arm Laparoscopy Surgical Robots Through Learning-from-Simulation

2026-01-21 · Sarvin Ghiasi, Majid Roshanfar, Jake Barralet, Liane S. Feldman 외 arxiv

This study presents an integrated framework for enhancing the safety and operational efficiency of robotic arms in laparoscopic surgery by addressing minimum distance estimation between multi-arm manipulators and the ass…