paper-with-me

Papers

Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study

2024-03-13 · Bowen Li, Wenhan Wu, Ziwei Tang, Lin Shi, John Yang, Jinyang Li, Shunyu Yao, Chen Qian, Binyuan Hui, Qicheng Zhang, Zhiyin Yu, He Du, Ping Yang, Dahua Lin, Chao Peng, Kai Chen

Recent advancements in large language models (LLMs) have significantly enhanced their coding capabilities. However, existing benchmarks predominantly focused on simplified or isolated aspects of coding, such as single-file code generation or repository issue debugging, falling short of measuring the full spectrum of challenges raised by real-world programming activities. In this case study, we explore the performance of LLMs across the entire software development lifecycle with DevEval, encompassing stages including software design, environment setup, implementation, acceptance testing, and unit testing. DevEval features four programming languages, multiple domains, high-quality data collection, and carefully designed and verified metrics for each task. Empirical studies show that current LLMs, including GPT-4, fail to solve the challenges presented within DevEval. Our findings offer actionable insights for the future development of LLMs toward real-world programming applications.

📄 PDF Abstract BibTeX arXiv:2403.08604

Code (2)

open-compass/devbench 공식 구현
open-compass/deveval 공식 구현

Tasks

Code Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Impact of Code Context and Prompting Strategies on Automated Unit Test Generation with Modern General-Purpose Large Language Models

2025-07-18 · Jakub Walczak, Piotr Tomalak, Artur Laskowski arxiv

Generative AI is gaining increasing attention in software engineering, where testing remains an indispensable reliability mechanism. According to the widely adopted testing pyramid, unit tests constitute the majority of …

Prompting Techniques for Secure Code Generation: A Systematic Investigation

2024-07-09 · Catherine Tony, Nicolás E. Díaz Ferreyra, Markus Mutas, Salem Dhiff 외

Large Language Models (LLMs) are gaining momentum in software development with prompt-driven programming enabling developers to create code from natural language (NL) instructions. However, studies have questioned their …

Code GenerationSystematic Literature Review

Querying Large Automotive Software Models: Agentic vs. Direct LLM Approaches

2025-06-16 · Lukasz Mazur, Nenad Petrovic, James Pontes Miranda, Ansgar Radermacher 외

Large language models (LLMs) offer new opportunities for interacting with complex software artifacts, such as software models, through natural language. They present especially promising benefits for large software model…

I Can Find You in Seconds! Leveraging Large Language Models for Code Authorship Attribution

2025-01-14 · Soohyeon Choi, Yong Kiam Tan, Mark Huasong Meng, Mohamed Ragab 외

Source code authorship attribution is important in software forensics, plagiarism detection, and protecting software patch integrity. Existing techniques often rely on supervised machine learning, which struggles with ge…

Adversarial RobustnessAttributeAuthorship AttributionFew-Shot Learning+1

Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models

2022-09-20 · COLING 2022 10 · Zichun Yu, Tianyu Gao, Zhengyan Zhang, Yankai Lin 외

Prompting, which casts downstream applications as language modeling tasks, has shown to be sample efficient compared to standard fine-tuning with pre-trained models. However, one pitfall of prompting is the need of manua…

Few-Shot LearningLanguage ModelingLanguage ModellingRe-Ranking