paper-with-me

홈 › Papers

Interpretable Robot Control via Structured Behavior Trees and Large Language Models

2025-08-13 · Ingrid Maéva Chekam, Ines Pastor-Martinez, Ali Tourani, Jose Andres Millan-Romera, Laura Ribeiro, Pedro Miguel Bastos Soares, Holger Voos, Jose Luis Sanchez-Lopez arxiv

As intelligent robots become more integrated into human environments, there is a growing need for intuitive and reliable Human-Robot Interaction (HRI) interfaces that are adaptable and more natural to interact with. Traditional robot control methods often require users to adapt to interfaces or memorize predefined commands, limiting usability in dynamic, unstructured environments. This paper presents a novel framework that bridges natural language understanding and robotic execution by combining Large Language Models (LLMs) with Behavior Trees. This integration enables robots to interpret natural language instructions given by users and translate them into executable actions by activating domain-specific plugins. The system supports scalable and modular integration, with a primary focus on perception-based functionalities, such as person tracking and hand gesture recognition. To evaluate the system, a series of real-world experiments was conducted across diverse environments. Experimental results demonstrate that the proposed approach is practical in real-world scenarios, with an average cognition-to-execution accuracy of approximately 94%, making a significant contribution to HRI systems and robots. The complete source code of the framework is publicly available at https://github.com/snt-arg/robot_suite.

📄 PDF Abstract BibTeX arXiv:2508.09621

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language UnderstandingHand Gesture Recognition

Similar Papers 제목 키워드 기반

Bridging Probabilistic Inference and Behavior Trees: An Interactive Framework for Adaptive Multi-Robot Cooperation

2025-12-04 · Chaoran Wang, Jingyuan Sun, Yanhui Zhang, Changju Wu arxiv

This paper proposes an Interactive Inference Behavior Tree (IIBT) framework that integrates behavior trees (BTs) with active inference under the free energy principle for distributed multi-robot decision-making. The prop…

A principled analysis of Behavior Trees and their generalisations

2020-08-27 · Oliver Biggar, Mohammad Zamani, Iman Shames

As complex autonomous robotic systems become more widespread, the need for transparent and reusable Artificial Intelligence (AI) designs becomes more apparent. In this paper we analyse how the principles behind Behavior …

Decision Making

Behavior Trees in Robot Control Systems

2022-03-24 · Petter Ögren, Christopher I. Sprague

In this paper we will give a control theoretic perspective on the research area of behavior trees in robotics. The key idea underlying behavior trees is to make use of modularity, hierarchies and feedback, in order to ha…

Closed-Loop Verbal Reinforcement Learning for Task-Level Robotic Planning

2026-03-23 · Dmitrii Plotnikov, Iaroslav Kolomiets, Dmitrii Maliukov, Dmitrij Kosenkov 외 arxiv

We propose a new Verbal Reinforcement Learning (VRL) framework for interpretable task-level planning in mobile robotic systems operating under execution uncertainty. The framework follows a closed-loop architecture that …

Reinforcement Learning

Video-to-BT: Generating Reactive Behavior Trees from Human Demonstration Videos for Robotic Assembly

2025-09-20 · Xiwei Zhao, Yiwei Wang, Yansong Wu, Fan Wu 외 arxiv

Modern manufacturing demands robotic assembly systems with enhanced flexibility and reliability. However, traditional approaches often rely on programming tailored to each product by experts for fixed settings, which are…