What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models
The term Language Models (LMs), as a time-specific collection of models of interest, is constantly reinvented, with its referents updated much like the $\textit{Ship of Theseus}$ replaces its parts but remains the same ship in essence. In this paper, we investigate this $\textit{Ship of Language Models}$ problem, wherein scientific evolution takes the form of continuous, implicit retrofits of key existing terms. We seek to initiate a novel perspective of scientific progress, in addition to the more well-studied emergence of new terms. To this end, we construct the data infrastructure based on recent NLP publications. Then, we perform a series of text-based analyses toward a detailed, quantitative understanding of the use of Language Models as a term of art. Our work highlights how systems and theories influence each other in scientific discourse, and we call for attention to the transformation of this Ship that we all are contributing to.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Gradual Classical Logic for Attributed Objects
There is knowledge. There is belief. And there is tacit agreement.' 'We may talk about objects. We may talk about attributes of the objects. Or we may talk both about objects and their attributes.' This work inspects tac…
AttributeRelationSentiment Analysis - What are we talking about?
What topic do you want to hear about? A bilingual talking robot using English and Japanese Wikipedias
We demonstrate a bilingual robot application, WikiTalk, that can talk fluently in both English and Japanese about almost any topic using information from English and Japanese Wikipedias. The English version of the system…
Navigate“Politeness, you simpleton!” retorted [MASK]: Masked prediction of literary characters
What is the best way to learn embeddings for entities, and what can be learned from them? We consider this question for the case of literary characters. We address the highly challenging task of guessing, from a sentence…
Entity EmbeddingsSentenceMeasuring Issue Ownership using Word Embeddings
Sentiment and topic analysis are common methods used for social media monitoring. Essentially, these methods answers questions such as, "what is being talked about, regarding X", and "what do people feel, regarding X". I…
Document EmbeddingWord Embeddings