Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild
User interactions with LLMs are shaped by prior experiences and individual exploration, but in-lab studies do not provide system designers with visibility into these in-the-wild factors. This work explores a new approach to studying real-world user-LLM interactions through large-scale chat logs from the wild. Through analysis of 140K chatbot sessions from 7,955 anonymized global users over time, we demonstrate key patterns in user expressions despite varied tasks: (1) LLM users are not tabula rasa, nor are they constantly adapting; rather, interaction patterns form and stabilize rapidly through individual early trajectories; (2) Longitudinal outcomes, such as recurring text patterns and retention rates, are strongly correlated with early exploration; (3) Parallel dynamics are present, including organizing expressions by task types such as emotional support, or in response to model-version updates. These results present an ``agency paradox'': despite LLM input spaces being unconstrained and user-driven, we in fact see less user exploration. We call for design consideration surrounding the molding procedure and its incorporation in future research.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Do Language Models Exhibit Human-like Structural Priming Effects?
We explore which linguistic factors -- at the sentence and token level -- play an important role in influencing language model predictions, and investigate whether these are reflective of results found in humans and huma…
Language ModelingLanguage ModellingSentenceInterpretable machine learning-accelerated seed treatment by nanomaterials for environmental stress alleviation
Crops are constantly challenged by different environmental conditions. Seed treatment by nanomaterials is a cost-effective and environmentally-friendly solution for environmental stress mitigation in crop plants. Here, 5…
Interpretable Machine LearningAttention-based Semantic Priming for Slot-filling
The problem of sequence labelling in language understanding would benefit from approaches inspired by semantic priming phenomena. We propose that an attention-based RNN architecture can be used to simulate semantic primi…
slot-fillingSlot FillingSpoken Language UnderstandingWord EmbeddingsStress, Depression and Neuroplasticity
Modifications of signaling pathways and synapses owing to changing behaviors, environments, numerous neural modulation as well as brain-tissue injuries is defined as neuroplasticity in developmental neurology. The centra…
Towards Human Cognition: Visual Context Guides Syntactic Priming in Fusion-Encoded Models
We introduced PRISMATIC, the first multimodal structural priming dataset, and proposed a reference-free evaluation metric that assesses priming effects without predefined target sentences. Using this metric, we construct…