Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers interact with these systems and identify ways to improve that interaction. To seek insights about human-AI collaboration with code recommendations systems, we studied GitHub Copilot, a code-recommendation system used by millions of programmers daily. We developed CUPS, a taxonomy of common programmer activities when interacting with Copilot. Our study of 21 programmers, who completed coding tasks and retrospectively labeled their sessions with CUPS, showed that CUPS can help us understand how programmers interact with code-recommendation systems, revealing inefficiencies and time costs. Our insights reveal how programmers interact with Copilot and motivate new interface designs and metrics.
Code (1)
Tasks
Code CompletionRecommendation SystemsSimilar Papers 제목 키워드 기반
PUNR: Pre-training with User Behavior Modeling for News Recommendation
News recommendation aims to predict click behaviors based on user behaviors. How to effectively model the user representations is the key to recommending preferred news. Existing works are mostly focused on improvements …
News RecommendationUnsupervised Pre-trainingModeling Task Effects in Human Reading with Neural Network-based Attention
Research on human reading has long documented that reading behavior shows task-specific effects, but it has been challenging to build general models predicting what reading behavior humans will show in a given task. We i…
Question AnsweringReading ComprehensionICE: Information Credibility Evaluation on Social Media via Representation Learning
With the rapid growth of social media, rumors are also spreading widely on social media and bring harm to people's daily life. Nowadays, information credibility evaluation has drawn attention from academic and industrial…
Feature EngineeringRepresentation LearningModeling Stage-wise Evolution of User Interests for News Recommendation
Personalized news recommendation is highly time-sensitive, as user interests are often driven by emerging events, trending topics, and shifting real-world contexts. These dynamics make it essential to model not only user…
PENS: A Dataset and Generic Framework for Personalized News Headline Generation
In this paper, we formulate the personalized news headline generation problem whose goal is to output a user-specific title based on both a user{'}s reading interests and a candidate news body to be exposed to her. To bu…
Headline Generation