How Linguistics Learned to Stop Worrying and Love the Language Models
Language models can produce fluent, grammatical text. Nonetheless, some maintain that language models don't really learn language and also that, even if they did, that would not be informative for the study of human learning and processing. On the other side, there have been claims that the success of LMs obviates the need for studying linguistic theory and structure. We argue that both extremes are wrong. LMs can contribute to fundamental questions about linguistic structure, language processing, and learning. They force us to rethink arguments and ways of thinking that have been foundational in linguistics. While they do not replace linguistic structure and theory, they serve as model systems and working proofs of concept for gradient, usage-based approaches to language. We offer an optimistic take on the relationship between language models and linguistics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
An NLP Curator (or: How I Learned to Stop Worrying and Love NLP Pipelines)
Natural Language Processing continues to grow in popularity in a range of research and commercial applications, yet managing the wide array of potential NLP components remains a difficult problem. This paper describes Cu…
ManagementMicrosoft's Submission to the WMT2018 News Translation Task: How I Learned to Stop Worrying and Love the Data
This paper describes the Microsoft submission to the WMT2018 news translation shared task. We participated in one language direction -- English-German. Our system follows current best-practice and combines state-of-the-a…
SentenceTranslationA Limited-Capacity Minimax Theorem for Non-Convex Games or: How I Learned to Stop Worrying about Mixed-Nash and Love Neural Nets
Adversarial training, a special case of multi-objective optimization, is an increasingly prevalent machine learning technique: some of its most notable applications include GAN-based generative modeling and self-play tec…
StarcraftStarcraft IIHow I learned to stop worrying and love the curse of dimensionality: an appraisal of cluster validation in high-dimensional spaces
The failure of the Euclidean norm to reliably distinguish between nearby and distant points in high dimensional space is well-known. This phenomenon of distance concentration manifests in a variety of data distributions,…
Clustering[Social] Allostasis: Or, How I Learned To Stop Worrying and Love The Noise
The notion of homeostasis typically conceptualises biological and artificial systems as maintaining stability by resisting deviations caused by environmental and social perturbations. In contrast, (social) allostasis pro…