Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions
Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text games, in which a player has to understand the environment and respond to situations by having dialogues with the game world. Our experiments show that ChatGPT performs competitively compared to all the existing systems but still exhibits a low level of intelligence. Precisely, ChatGPT can not construct the world model by playing the game or even reading the game manual; it may fail to leverage the world knowledge that it already has; it cannot infer the goal of each step as the game progresses. Our results open up new research questions at the intersection of artificial intelligence, machine learning, and natural language processing.
Code (0)
등록된 구현이 없습니다.
Tasks
World KnowledgeMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Language Model-In-The-Loop: Data Optimal Approach to Learn-To-Recommend Actions in Text Games
Large Language Models (LLMs) have demonstrated superior performance in language understanding benchmarks. CALM, a popular approach, leverages linguistic priors of LLMs -- GPT-2 -- for action candidate recommendations to …
Language ModelingLanguage Modellingtext-based gamesPLAYER*: Enhancing LLM-based Multi-Agent Communication and Interaction in Murder Mystery Games
We introduce WellPlay, a reasoning dataset for multi-agent conversational inference in Murder Mystery Games (MMGs). WellPlay comprises 1,482 inferential questions across 12 games, spanning objectives, reasoning, and rela…
Decision MakingLanguage ModelingLanguage ModellingLarge Language Model+2Exploration Based Language Learning for Text-Based Games
This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natu…
Imitation Learningtext-based gamesText GenerationPlaying games with Large language models: Randomness and strategy
Playing games has a long history of describing intricate interactions in simplified forms. In this paper we explore if large language models (LLMs) can play games, investigating their capabilities for randomisation and s…
TextWorld: A Learning Environment for Text-based Games
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backe…
Reinforcement Learningtext-based gamesTransfer Learning