paper-with-me

홈 › Papers

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

2023-10-30 · Bram M. A. van Dijk, Tom Kouwenhoven, Marco R. Spruit, Max J. van Duijn

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this position paper, we first zoom in on the debate and critically assess three points recurring in critiques of LLM capacities: i) that LLMs only parrot statistical patterns in the training data; ii) that LLMs master formal but not functional language competence; and iii) that language learning in LLMs cannot inform human language learning. Drawing on empirical and theoretical arguments, we show that these points need more nuance. Second, we outline a pragmatic perspective on the issue of `real' understanding and intentionality in LLMs. Understanding and intentionality pertain to unobservable mental states we attribute to other humans because they have pragmatic value: they allow us to abstract away from complex underlying mechanics and predict behaviour effectively. We reflect on the circumstances under which it would make sense for humans to similarly attribute mental states to LLMs, thereby outlining a pragmatic philosophical context for LLMs as an increasingly prominent technology in society.

📄 PDF Abstract BibTeX arXiv:2310.19671

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Similar Papers 제목 키워드 기반

A Computational Method for Evaluating UI Patterns

2018-07-11 · Bardia Doosti, Tao Dong, Biplab Deka, Jeffrey Nichols

UI design languages, such as Google's Material Design, make applications both easier to develop and easier to learn by providing a set of standard UI components. Nonetheless, it is hard to assess the impact of design lan…

Data-Driven Dialogue Systems for Social Agents

2017-09-10 · Kevin K. Bowden, Shereen Oraby, Amita Misra, Jiaqi Wu 외

In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorpora…

Retrieval

Evaluating the Performance of Large Language Models via Debates

2024-06-16 · Behrad Moniri, Hamed Hassani, Edgar Dobriban

Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evalua…

Benchmarking

Mining United Nations General Assembly Debates

2024-06-19 · Mateusz Grzyb, Mateusz Krzyziński, Bartłomiej Sobieski, Mikołaj Spytek 외

This project explores the application of Natural Language Processing (NLP) techniques to analyse United Nations General Assembly (UNGA) speeches. Using NLP allows for the efficient processing and analysis of large volume…

DescriptiveSentiment Analysis

DebateBench: A Challenging Long Context Reasoning Benchmark For Large Language Models

2025-02-10 · Utkarsh Tiwari, Aryan Seth, Adi Mukherjee, Kaavya Mer 외

We introduce DebateBench, a novel dataset consisting of an extensive collection of transcripts and metadata from some of the world's most prestigious competitive debates. The dataset consists of British Parliamentary deb…

In-Context Learning