Code Completion
6개 벤치마크 · 논문 279편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
StarCoder 2 and The Stack v2: The Next Generation
DataSculpt: Crafting Data Landscapes for Long-Context LLMs through Multi-Objective Partitioning
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
Open Vocabulary Learning on Source Code with a Graph-Structured Cache
Papers
CS-Guard: Benchmarking LLM Guardrails for Code Generation Security
Large language models (LLMs) have been ex- ploited to generate malware, but the effective- ness of guardrails for code generation secu- rity remains unclear. We introduce CS-Guard, the first benchmark to systematically e…
Text-to-Code GenerationCode TranslationCode CompletionLarge Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda
Large Language Models (LLMs) are moving from code completion toward repository-scale agents that retrieve context, edit files, execute tools, and participate in security-sensitive workflows. The evidence for these system…
Vulnerability DetectionCode CompletionBeware What You Autocomplete: Forensic Attribution of Backdoored Code Completions
Large language models have enabled powerful code completion systems that assist developers by predicting subsequent lines of code. However, these models remain vulnerable to backdoor attacks, where malicious fine-tuning …
Code CompletionTeaching LLMs a Low-Resource Language: Enhancing Code Completion in Pharo
Large Language Models (LLMs) unlocked new possibilities in automated code writing, becoming the backbone of most code completion tools. While LLMs excel in mainstream languages, they often lack support for the so-called …
Code CompletionTo Tab or Not to Tab: Measuring Critical Engagement in AI Code Completion Tools Using Behavioral Signals and Attention Checks
AI code completion tools, such as Github Copilot, provide students with code suggestions to help them write programs. However, recent qualitative studies suggest that students fail to critically evaluate these suggestion…
Code CompletionJAMER: Project-Level Code Framework Dataset and Benchmark on Professional Game Engines
Current AI-driven game development has made substantial progress in asset generation, gameplay design, and web-based game coding, yet project-level code engineering on professional game engines remains largely unexplored…
Code Completion