IntelliCode Compose: Code Generation Using Transformer
In software development through integrated development environments (IDEs), code completion is one of the most widely used features. Nevertheless, majority of integrated development environments only support completion of methods and APIs, or arguments. In this paper, we introduce IntelliCode Compose $-$ a general-purpose multilingual code completion tool which is capable of predicting sequences of code tokens of arbitrary types, generating up to entire lines of syntactically correct code. It leverages state-of-the-art generative transformer model trained on 1.2 billion lines of source code in Python, $C\#$, JavaScript and TypeScript programming languages. IntelliCode Compose is deployed as a cloud-based web service. It makes use of client-side tree-based caching, efficient parallel implementation of the beam search decoder, and compute graph optimizations to meet edit-time completion suggestion requirements in the Visual Studio Code IDE and Azure Notebook. Our best model yields an average edit similarity of $86.7\%$ and a perplexity of 1.82 for Python programming language.
Code (0)
등록된 구현이 없습니다.
Tasks
Code CompletionCode GenerationDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling
LLM-based tutors are typically single-turn assistants that lack persistent representations of learner knowledge, making it difficult to provide principled, transparent, and long-term pedagogical support. We introduce Int…
Pythia: AI-assisted Code Completion System
In this paper, we propose a novel end-to-end approach for AI-assisted code completion called Pythia. It generates ranked lists of method and API recommendations which can be used by software developers at edit time. The …
Code CompletionLanguage ModelingLanguage ModellingTransforming Image Generation from Scene Graphs
Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or tex…
DecoderImage GenerationImage Generation from Scene GraphsProbabilistic Neural Programmed Networks for Scene Generation
In this paper we address the text to scene image generation problem. Generative models that capture the variability in complicated scenes containing rich semantics is a grand goal of image generation. Complicated scene i…
Image GenerationScene GenerationA Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation
Despite recent achievements of deep learning automatic music generation algorithms, few approaches have been proposed to evaluate whether a single-track music excerpt is composed by automatons or Homo sapiens. To tackle …
Data AugmentationInformation RetrievalLanguage ModelingLanguage Modelling+3