Context Composing for Full Line Code Completion

2024-02-14 · Anton Semenkin, Yaroslav Sokolov, Evgeniia Vu

Code Completion is one of the most used Integrated Development Environment (IDE) features, which affects the everyday life of a software developer. Modern code completion approaches moved from the composition of several static analysis-based contributors to pipelines that involve neural networks. This change allows the proposal of longer code suggestions while maintaining the relatively short time spent on generation itself. At JetBrains, we put a lot of effort into perfecting the code completion workflow so it can be both helpful and non-distracting for a programmer. We managed to ship the Full Line Code Completion feature to PyCharm Pro IDE and proved its usefulness in A/B testing on hundreds of real Python users. The paper describes our approach to context composing for the Transformer model that is a core of the feature's implementation. In addition to that, we share our next steps to improve the feature and emphasize the importance of several research aspects in the area.

📄 PDF Abstract BibTeX arXiv:2402.09230

Code (0)

등록된 구현이 없습니다.

Tasks

Code Completion

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Position-Wise Feed-Forward Layer 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completion

2024-07-02 · Bohan Li, Jiajun Deng, Wenyao Zhang, Zhujin Liang 외

Camera-based 3D semantic scene completion (SSC) is pivotal for predicting complicated 3D layouts with limited 2D image observations. The existing mainstream solutions generally leverage temporal information by roughly st…

3D Semantic Scene Completion valid

R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Models

2024-06-03 · Ken Deng, Jiaheng Liu, He Zhu, Congnan Liu 외

Code completion models have made significant progress in recent years. Recently, repository-level code completion has drawn more attention in modern software development, and several baseline methods and benchmarks have …

Benchmarking Code Completion Retrieval

CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context

2022-12-20 · Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad, Murali Krishna Ramanathan 외

While pre-trained language models (LM) for code have achieved great success in code completion, they generate code conditioned only on the contents within the file, i.e., in-file context, but ignore the rich semantics in…

Code Completion

RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completion

2024-03-10 · Huy N. Phan, Hoang N. Phan, Tien N. Nguyen, Nghi D. Q. Bui

Code Large Language Models (CodeLLMs) have demonstrated impressive proficiency in code completion tasks. However, they often fall short of fully understanding the extensive context of a project repository, such as the in…

Code Completion Link Prediction Retrieval

Locally Masked Convolution for Autoregressive Models

2020-06-22 · Ajay Jain, Pieter Abbeel, Deepak Pathak

High-dimensional generative models have many applications including image compression, multimedia generation, anomaly detection and data completion. State-of-the-art estimators for natural images are autoregressive, deco…

Anomaly Detection Density Estimation Image Compression Image Generation