LTL2Action: Generalizing LTL Instructions for Multi-Task RL
We address the problem of teaching a deep reinforcement learning (RL) agent to follow instructions in multi-task environments. Instructions are expressed in a well-known formal language -- linear temporal logic (LTL) -- and can specify a diversity of complex, temporally extended behaviours, including conditionals and alternative realizations. Our proposed learning approach exploits the compositional syntax and the semantics of LTL, enabling our RL agent to learn task-conditioned policies that generalize to new instructions, not observed during training. To reduce the overhead of learning LTL semantics, we introduce an environment-agnostic LTL pretraining scheme which improves sample-efficiency in downstream environments. Experiments on discrete and continuous domains target combinatorial task sets of up to $\sim10^{39}$ unique tasks and demonstrate the strength of our approach in learning to solve (unseen) tasks, given LTL instructions.
Code (1)
Tasks
Deep Reinforcement LearningDiversityReinforcement Learning (RL)Similar Papers 제목 키워드 기반
OpenHOI: Open-World Hand-Object Interaction Synthesis with Multimodal Large Language Model
Understanding and synthesizing realistic 3D hand-object interactions (HOI) is critical for applications ranging from immersive AR/VR to dexterous robotics. Existing methods struggle with generalization, performing well o…
Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language ModelBenchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extraction
Information Extraction (IE) is an essential task in Natural Language Processing. Traditional methods have relied on coarse-grained extraction with simple instructions. However, with the emergence of Large Language Models…
BenchmarkingDecoderDiversityCoEdIT: Text Editing by Task-Specific Instruction Tuning
We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "Make the sentence simpler" or "Write it …
Formality Style TransferGrammatical Error CorrectionLanguage ModelingLarge Language Model+4Neurosymbolic AI for Enhancing Instructability in Generative AI
Generative AI, especially via Large Language Models (LLMs), has transformed content creation across text, images, and music, showcasing capabilities in following instructions through prompting, largely facilitated by ins…
In a Nutshell, the Human Asked for This: Latent Goals for Following Temporal Specifications
We address the problem of building agents whose goal is to learn to execute out-of distribution (OOD) multi-task instructions expressed in temporal logic (TL) by using deep reinforcement learning (DRL). Recent works prov…
Deep Reinforcement Learning