paper-with-me

홈 › Papers

Uniform Information Density and Syntactic Reduction: Revisiting $\textit{that}$-Mentioning in English Complement Clauses

2025-09-05 · Hailin Hao, Elsi Kaiser arxiv

Speakers often have multiple ways to express the same meaning. The Uniform Information Density (UID) hypothesis suggests that speakers exploit this variability to maintain a consistent rate of information transmission during language production. Building on prior work linking UID to syntactic reduction, we revisit the finding that the optional complementizer $\textit{that}$ in English complement clauses is more likely to be omitted when the clause has low information density (i.e., more predictable). We advance this line of research by analyzing a large-scale, contemporary conversational corpus and using machine learning and neural language models to refine estimates of information density. Our results replicated the established relationship between information density and $\textit{that}$-mentioning. However, we found that previous measures of information density based on matrix verbs' subcategorization probability capture substantial idiosyncratic lexical variation. By contrast, estimates derived from contextual word embeddings account for additional variance in patterns of complementizer usage.

📄 PDF Abstract BibTeX arXiv:2509.05254

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

That's Optional: A Contemporary Exploration of "that" Omission in English Subordinate Clauses

2024-05-31 · Ella Rabinovich

The Uniform Information Density (UID) hypothesis posits that speakers optimize the communicative properties of their utterances by avoiding spikes in information, thereby maintaining a relatively uniform information prof…

Uniform Information Density Effects on Syntactic Choice in Hindi

2018-08-01 · WS 2018 8 · Ayush Jain, Vishal Singh, Sidharth Ranjan, Rajakrishnan Rajkumar 외

According to the UNIFORM INFORMATION DENSITY (UID) hypothesis (Levy and Jaeger, 2007; Jaeger, 2010), speakers tend to distribute information density across the signal uniformly while producing language. The prior works c…

Sentence

Revisiting the Uniform Information Density Hypothesis in LLM Reasoning

2025-10-08 · Minju Gwak, Guijin Son, Jaehyung Kim arxiv

The Uniform Information Density (UID) hypothesis proposes that effective communication is achieved by maintaining a stable flow of information. In this work, we revisit this principle in the context of Large Language Mod…

Revisiting Entropy Rate Constancy in Text

2023-05-20 · Vivek Verma, Nicholas Tomlin, Dan Klein

The uniform information density (UID) hypothesis states that humans tend to distribute information roughly evenly across an utterance or discourse. Early evidence in support of the UID hypothesis came from Genzel & Charn…

Revisiting the UID Hypothesis in LLM Reasoning Traces

2025-10-11 · Minju Gwak, Guijin Son, Jaehyung Kim arxiv

Large language models (LLMs) often solve problems using step-by-step Chain-of-Thought (CoT) reasoning, yet these intermediate steps are frequently unfaithful or hard to interpret. Inspired by the Uniform Information Dens…