paper-with-me

홈 › Papers

Can LLMs Translate Human Instructions into a Reinforcement Learning Agent's Internal Emergent Symbolic Representation?

2025-10-28 · Ziqi Ma, Sao Mai Nguyen, Philippe Xu arxiv

Emergent symbolic representations are critical for enabling developmental learning agents to plan and generalize across tasks. In this work, we investigate whether large language models (LLMs) can translate human natural language instructions into the internal symbolic representations that emerge during hierarchical reinforcement learning. We apply a structured evaluation framework to measure the translation performance of commonly seen LLMs -- GPT, Claude, Deepseek and Grok -- across different internal symbolic partitions generated by a hierarchical reinforcement learning algorithm in the Ant Maze and Ant Fall environments. Our findings reveal that although LLMs demonstrate some ability to translate natural language into a symbolic representation of the environment dynamics, their performance is highly sensitive to partition granularity and task complexity. The results expose limitations in current LLMs capacity for representation alignment, highlighting the need for further research on robust alignment between language and internal agent representations.

📄 PDF Abstract BibTeX arXiv:2510.24259

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning

Similar Papers 제목 키워드 기반

Building Open-Ended Embodied Agent via Language-Policy Bidirectional Adaptation

2023-12-12 · Shaopeng Zhai, Jie Wang, Tianyi Zhang, Fuxian Huang 외

Building embodied agents on integrating Large Language Models (LLMs) and Reinforcement Learning (RL) have revolutionized human-AI interaction: researchers can now leverage language instructions to plan decision-making fo…

Decision MakingLanguage ModellingReinforcement Learning (RL)

Navigational Instruction Generation as Inverse Reinforcement Learning with Neural Machine Translation

2016-10-11 · Andrea F. Daniele, Mohit Bansal, Matthew R. Walter

Modern robotics applications that involve human-robot interaction require robots to be able to communicate with humans seamlessly and effectively. Natural language provides a flexible and efficient medium through which r…

Machine TranslationNavigatereinforcement-learningReinforcement Learning+2

Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning

2024-04-22 · Mohammed Abugurain, Shinkyu Park

This paper presents a framework that can interpret humans' navigation commands containing temporal elements and directly translate their natural language instructions into robot motion planning. Central to our framework …

Motion Planning

From Templates to Natural Language: Generalization Challenges in Instruction-Tuned LLMs for Spatial Reasoning

2025-05-20 · Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen

Instruction-tuned large language models (LLMs) have shown strong performance on a variety of tasks; however, generalizing from synthetic to human-authored instructions in grounded environments remains a challenge for the…

Spatial Reasoning

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

2024-08-15 · Shaojun Xu, Xusheng Luo, Yutong Huang, Letian Leng 외

To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can oc…

Natural Language UnderstandingRobot Task PlanningSentenceTask Planning+1