paper-with-me

Papers

Exploration Based Language Learning for Text-Based Games

2020-01-24 · Andrea Madotto, Mahdi Namazifar, Joost Huizinga, Piero Molino, Adrien Ecoffet, Huaixiu Zheng, Alexandros Papangelis, Dian Yu, Chandra Khatri, Gokhan Tur

This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natural language and expect the player to interact with the game using text. These games are of interest as they can be seen as a testbed for language understanding, problem-solving, and language generation by artificial agents. Moreover, they provide a learning environment in which these skills can be acquired through interactions with an environment rather than using fixed corpora. One aspect that makes these games particularly challenging for learning agents is the combinatorially large action space. Existing methods for solving text-based games are limited to games that are either very simple or have an action space restricted to a predetermined set of admissible actions. In this work, we propose to use the exploration approach of Go-Explore for solving text-based games. More specifically, in an initial exploration phase, we first extract trajectories with high rewards, after which we train a policy to solve the game by imitating these trajectories. Our experiments show that this approach outperforms existing solutions in solving text-based games, and it is more sample efficient in terms of the number of interactions with the environment. Moreover, we show that the learned policy can generalize better than existing solutions to unseen games without using any restriction on the action space.

📄 PDF Abstract BibTeX arXiv:2001.08868

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learningtext-based gamesText Generation

Methods 이 논문이 사용한 방법론

Go-Explore Go-Explore is a family of algorithms aiming to tackle two challenges with effective exploration in reinforcement learning: algorithms forgetting how to reach previously…

Similar Papers 제목 키워드 기반

Fire Burns, Sword Cuts: Commonsense Inductive Bias for Exploration in Text-based Games

2022-05-01 · ACL 2022 5 · Dongwon Ryu, Ehsan Shareghi, Meng Fang, Yunqiu Xu 외

Text-based games (TGs) are exciting testbeds for developing deep reinforcement learning techniques due to their partially observed environments and large action spaces. In these games, the agent learns to explore the env…

Deep Reinforcement LearningEfficient ExplorationInductive BiasLanguage Modeling+2

A Minimal Approach for Natural Language Action Space in Text-based Games

2023-05-06 · Dongwon Kelvin Ryu, Meng Fang, Shirui Pan, Gholamreza Haffari 외

Text-based games (TGs) are language-based interactive environments for reinforcement learning. While language models (LMs) and knowledge graphs (KGs) are commonly used for handling large action space in TGs, it is unclea…

Knowledge Graphstext-based games

EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning

2024-03-15 · Kinjal Basu, Keerthiram Murugesan, Subhajit Chaudhury, Murray Campbell 외

Text-based games (TBGs) have emerged as an important collection of NLP tasks, requiring reinforcement learning (RL) agents to combine natural language understanding with reasoning. A key challenge for agents attempting t…

Natural Language Understandingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning

2018-12-04 · NAACL 2019 6 · Prithviraj Ammanabrolu, Mark O. Riedl

Text-based adventure games provide a platform on which to explore reinforcement learning in the context of a combinatorial action space, such as natural language. We present a deep reinforcement learning architecture tha…

Deep Reinforcement LearningEfficient ExplorationQuestion Answeringreinforcement-learning+3

Counting to Explore and Generalize in Text-based Games

2018-06-29 · Xingdi Yuan, Marc-Alexandre Côté, Alessandro Sordoni, Romain Laroche 외

We propose a recurrent RL agent with an episodic exploration mechanism that helps discovering good policies in text-based game environments. We show promising results on a set of generated text-based games of varying dif…

text-based games