paper-with-me

홈 › Papers

The Vibe-Check Protocol: Quantifying Cognitive Offloading in AI Programming

2026-01-02 · Aizierjiang Aiersilan arxiv

The integration of Large Language Models (LLMs) into software engineering education has driven the emergence of ``Vibe Coding,'' a paradigm where developers articulate high-level intent through natural language and delegate implementation to AI agents. While proponents argue this approach modernizes pedagogy by emphasizing conceptual design over syntactic memorization, accumulating empirical evidence raises concerns regarding skill retention and deep conceptual understanding. This paper proposes a theoretical framework to investigate the research question: \textit{Is Vibe Coding a better way to learn software engineering?} We posit a divergence in student outcomes between those leveraging AI for acceleration versus those using it for cognitive offloading. To evaluate these educational trade-offs, we propose the \textbf{Vibe-Check Protocol (VCP)}, a systematic benchmarking framework incorporating three quantitative metrics: the \textit{Cold Start Refactor} ($M_{CSR}$) for modeling skill decay; \textit{Hallucination Trap Detection} ($M_{HT}$) based on signal detection theory to evaluate error identification; and the \textit{Explainability Gap} ($E_{gap}$) for quantifying the divergence between code complexity and conceptual comprehension. Through controlled comparisons, VCP aims to provide a quantitative basis for educators to determine the optimal pedagogical boundary: identifying contexts where Vibe Coding fosters genuine mastery and contexts where it introduces hidden technical debt and superficial competence.

📄 PDF Abstract BibTeX arXiv:2601.02410

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mitigating "Epistemic Debt" in Generative AI-Scaffolded Novice Programming using Metacognitive Scripts

2026-02-22 · Sreecharan Sankaranarayanan arxiv

The democratization of Large Language Models has given rise to vibe coding, where novice programmers prioritize semantic intent over syntactic implementation. Without pedagogical guardrails, we argue this is fundamentall…

VibeCheck: Discover and Quantify Qualitative Differences in Large Language Models

2024-10-10 · Lisa Dunlap, Krishna Mandal, Trevor Darrell, Jacob Steinhardt 외

Large language models (LLMs) often exhibit subtle yet distinctive characteristics in their outputs that users intuitively recognize, but struggle to quantify. These "vibes" -- such as tone, formatting, or writing style -…

Math

Vibe to Code: Elucidating Strategic Oscillation of Tacit Knowledge in Generative AI Design Workflows -- An Exploratory Qualitative Study

2026-07-25 · Daisaku Sato arxiv

The rapid adoption of generative AI tools has created new literacy demands for designers who must verbalize tacit knowledge through natural language prompts. Yet the micro-level cognitive processes by which designers ext…

Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models

2024-05-03 · Piotr Padlewski, Max Bain, Matthew Henderson, Zhongkai Zhu 외

We introduce Vibe-Eval: a new open benchmark and framework for evaluating multimodal chat models. Vibe-Eval consists of 269 visual understanding prompts, including 100 of hard difficulty, complete with gold-standard resp…

Belief Offloading in Human-AI Interaction

2026-02-09 · Rose E. Guingrich, Dvija Mehta, Umang Bhatt arxiv

What happens when people's beliefs are derived from information provided by an LLM? People's use of LLM chatbots as thought partners can contribute to cognitive offloading, which can have adverse effects on cognitive ski…