paper-with-me

Papers

A deep language model for software code

2016-08-09 · Hoa Khanh Dam, Truyen Tran, Trang Pham

Existing language models such as n-grams for software code often fail to capture a long context where dependent code elements scatter far apart. In this paper, we propose a novel approach to build a language model for software code to address this particular issue. Our language model, partly inspired by human memory, is built upon the powerful deep learning-based Long Short Term Memory architecture that is capable of learning long-term dependencies which occur frequently in software code. Results from our intrinsic evaluation on a corpus of Java projects have demonstrated the effectiveness of our language model. This work contributes to realizing our vision for DeepSoft, an end-to-end, generic deep learning-based framework for modeling software and its development process.

📄 PDF Abstract BibTeX arXiv:1608.02715

Code (1)

D-a-r-e-k/Source-Code-Modelling pytorch

Tasks

Deep LearningLanguage ModelingLanguage Modellingmodel

Similar Papers 제목 키워드 기반

JavaBERT: Training a transformer-based model for the Java programming language

2021-10-20 · Nelson Tavares de Sousa, Wilhelm Hasselbring

Code quality is and will be a crucial factor while developing new software code, requiring appropriate tools to ensure functional and reliable code. Machine learning techniques are still rarely used for software engineer…

Language ModelingLanguage ModellingMasked Language ModelingRetrieval

CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing

2021-04-06 · Ahmed Elnaggar, Wei Ding, Llion Jones, Tom Gibbs 외

Currently, a growing number of mature natural language processing applications make people's life more convenient. Such applications are built by source code - the language in software engineering. However, the applicati…

API Sequence RecommendationCode Comment GenerationCode Documentation GenerationCode Generation+7

From Copilot to Pilot: Towards AI Supported Software Development

2023-03-07 · Rohith Pudari, Neil A. Ernst

AI-supported programming has arrived, as shown by the introduction and successes of large language models for code, such as Copilot/Codex (Github/OpenAI) and AlphaCode (DeepMind). Above human average performance on progr…

Code Completion

Will AI replace Software Engineers? Do not hold your breath

2025-02-27 · Abhik Roychoudhury, Andreas Zeller

Artificial Intelligence (AI) technology such as Large Language Models (LLMs) have become extremely popular in creating code. This has led to the conjecture that future software jobs will be exclusively conducted by LLMs,…

Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassian

2025-01-20 · Wannita Takerngsaksiri, Micheal Fu, Chakkrit Tantithamthavorn, Jirat Pasuksmit 외

Software engineers spend a significant amount of time reading code during the software development process. This trend is amplified by the emergence of large language models (LLMs) that automatically generate code. Howev…