paper-with-me

Papers

Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions

2023-04-06 · Chen Feng Tsai, Xiaochen Zhou, Sierra S. Liu, Jing Li, Mo Yu, Hongyuan Mei

Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text games, in which a player has to understand the environment and respond to situations by having dialogues with the game world. Our experiments show that ChatGPT performs competitively compared to all the existing systems but still exhibits a low level of intelligence. Precisely, ChatGPT can not construct the world model by playing the game or even reading the game manual; it may fail to leverage the world knowledge that it already has; it cannot infer the goal of each step as the game progresses. Our results open up new research questions at the intersection of artificial intelligence, machine learning, and natural language processing.

📄 PDF Abstract BibTeX arXiv:2304.02868

Code (0)

등록된 구현이 없습니다.

Tasks

World Knowledge

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
fail 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Language Model-In-The-Loop: Data Optimal Approach to Learn-To-Recommend Actions in Text Games

2023-11-13 · Arjun Vaithilingam Sudhakar, Prasanna Parthasarathi, Janarthanan Rajendran, Sarath Chandar

Large Language Models (LLMs) have demonstrated superior performance in language understanding benchmarks. CALM, a popular approach, leverages linguistic priors of LLMs -- GPT-2 -- for action candidate recommendations to …

Language ModelingLanguage Modellingtext-based games

PLAYER*: Enhancing LLM-based Multi-Agent Communication and Interaction in Murder Mystery Games

2024-04-26 · Qinglin Zhu, Runcong Zhao, Bin Liang, Jinhua Du 외

We introduce WellPlay, a reasoning dataset for multi-agent conversational inference in Murder Mystery Games (MMGs). WellPlay comprises 1,482 inferential questions across 12 games, spanning objectives, reasoning, and rela…

Decision MakingLanguage ModelingLanguage ModellingLarge Language Model+2

Exploration Based Language Learning for Text-Based Games

2020-01-24 · Andrea Madotto, Mahdi Namazifar, Joost Huizinga, Piero Molino 외

This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natu…

Imitation Learningtext-based gamesText Generation

Playing games with Large language models: Randomness and strategy

2025-03-04 · Alicia Vidler, Toby Walsh

Playing games has a long history of describing intricate interactions in simplified forms. In this paper we explore if large language models (LLMs) can play games, investigating their capabilities for randomisation and s…

TextWorld: A Learning Environment for Text-based Games

2018-06-29 · Marc-Alexandre Côté, Ákos Kádár, Xingdi Yuan, Ben Kybartas 외

We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backe…

Reinforcement Learningtext-based gamesTransfer Learning