paper-with-me

홈 › Papers

Probabilistic Method of Measuring Linguistic Productivity

2023-08-24 · Sergei Monakhov

In this paper I propose a new way of measuring linguistic productivity that objectively assesses the ability of an affix to be used to coin new complex words and, unlike other popular measures, is not directly dependent upon token frequency. Specifically, I suggest that linguistic productivity may be viewed as the probability of an affix to combine with a random base. The advantages of this approach include the following. First, token frequency does not dominate the productivity measure but naturally influences the sampling of bases. Second, we are not just counting attested word types with an affix but rather simulating the construction of these types and then checking whether they are attested in the corpus. Third, a corpus-based approach and randomised design assure that true neologisms and words coined long ago have equal chances to be selected. The proposed algorithm is evaluated both on English and Russian data. The obtained results provide some valuable insights into the relation of linguistic productivity to the number of types and tokens. It looks like burgeoning linguistic productivity manifests itself in an increasing number of types. However, this process unfolds in two stages: first comes the increase in high-frequency items, and only then follows the increase in low-frequency items.

📄 PDF Abstract BibTeX arXiv:2308.12643

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Assessing the Linguistic Productivity of Unsupervised Deep Neural Networks

2017-06-06 · Lawrence Phillips, Nathan Hodas

Increasingly, cognitive scientists have demonstrated interest in applying tools from deep learning. One use for deep learning is in language acquisition where it is useful to know if a linguistic phenomenon can be learne…

Deep LearningLanguage Acquisition

The Corrective Commit Probability Code Quality Metric

2020-07-21 · Idan Amit, Dror G. Feitelson

We present a code quality metric, Corrective Commit Probability (CCP), measuring the probability that a commit reflects corrective maintenance. We show that this metric agrees with developers' concept of quality, informa…

Linguistic Productivity in Large Language Models: Models Coerce, but do not Preempt

2026-06-01 · Claire Bonial, Claire Benet Post, Laura Michaelis, Harish Tayyar Madabushi arxiv

Usage-based theories of grammars posit that creative productivity of the structures of language is both bolstered and constrained by two distinct frequency signals: entrenchment, stemming from high frequency usage, and p…

Information-based Modeling of Diachronic Linguistic Change: from Typicality to Productivity

2016-08-01 · WS 2016 8 · Stefania Degaetano-Ortlieb, Elke Teich
Information Retrieval

On Hapax Legomena and Morphological Productivity

2018-10-01 · WS 2018 10 · Janet Pierrehumbert, Ramon Granell

Quantifying and predicting morphological productivity is a long-standing challenge in corpus linguistics and psycholinguistics. The same challenge reappears in natural language processing in the context of handling words…