paper-with-me

Papers

Pre-Filtering Code Suggestions using Developer Behavioral Telemetry to Optimize LLM-Assisted Programming

2025-11-24 · Mohammad Nour Al Awad, Sergey Ivanov, Olga Tikhonova arxiv

Large Language Models (LLMs) are increasingly integrated into code editors to provide AI-powered code suggestions. Yet many of these suggestions are ignored, resulting in wasted computation, increased latency, and unnecessary interruptions. We introduce a lightweight pre-filtering model that predicts the likelihood of suggestion acceptance before invoking the LLM, using only real-time developer telemetry such as typing speed, file navigation, and editing activity. Deployed in a production-grade Visual Studio Code plugin over four months of naturalistic use, our approach nearly doubled acceptance rates (18.4% -> 34.2%) while suppressing 35% of low-value LLM calls. These findings demonstrate that behavioral signals alone can meaningfully improve both user experience and system efficiency in LLM-assisted programming, highlighting the value of timing-aware, privacy-preserving adaptation mechanisms. The filter operates solely on pre-invocation editor telemetry and never inspects code or prompts.

📄 PDF Abstract BibTeX arXiv:2511.18849

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Tasks

2025-10-13 · Jeena Javahar, Tanya Budhrani, Manaal Basha, Cleidson R. B. de Souza 외 arxiv

The use of AI code-generation tools is becoming increasingly common, making it important to understand how software developers are adopting these tools. In this study, we investigate how developers engage with Amazon's C…

A Transformer-Based Approach for Smart Invocation of Automatic Code Completion

2024-05-23 · Aral de Moor, Arie van Deursen, Maliheh Izadi

Transformer-based language models are highly effective for code completion, with much research dedicated to enhancing the content of these completions. Despite their effectiveness, these models come with high operational…

Code Completion

CodeWatcher: IDE Telemetry Data Extraction Tool for Understanding Coding Interactions with LLMs

2025-10-13 · Manaal Basha, Aimeê M. Ribeiro, Jeena Javahar, Cleidson R. B. de Souza 외 arxiv

Understanding how developers interact with code generation tools (CGTs) requires detailed, real-time data on programming behavior which is often difficult to collect without disrupting workflow. We present \textit{CodeWa…

Code Generation

Multi-line AI-assisted Code Authoring

2024-02-06 · Omer Dunay, Daniel Cheng, Adam Tait, Parth Thakkar 외

CodeCompose is an AI-assisted code authoring tool powered by large language models (LLMs) that provides inline suggestions to 10's of thousands of developers at Meta. In this paper, we present how we scaled the product f…

Overwatch: Learning Patterns in Code Edit Sequences

2022-07-25 · Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar 외

Integrated Development Environments (IDEs) provide tool support to automate many source code editing tasks. Traditionally, IDEs use only the spatial context, i.e., the location where the developer is editing, to generate…