Retrieval Augmented Code Generation and Summarization
Software developers write a lot of source code and documentation during software development. Intrinsically, developers often recall parts of source code or code summaries that they had written in the past while implementing software or documenting them. To mimic developers' code or summary generation behavior, we propose a retrieval augmented framework, REDCODER, that retrieves relevant code or summaries from a retrieval database and provides them as a supplement to code generation or summarization models. REDCODER has a couple of uniqueness. First, it extends the state-of-the-art dense retrieval technique to search for relevant code or summaries. Second, it can work with retrieval databases that include unimodal (only code or natural language description) or bimodal instances (code-description pairs). We conduct experiments and extensive analysis on two benchmark datasets of code generation and summarization in Java and Python, and the promising results endorse the effectiveness of our proposed retrieval augmented framework.
Code (2)
Tasks
Code GenerationCode SummarizationRetrievalSimilar Papers 제목 키워드 기반
Retrieval-Augmented Generation for Code Summarization via Hybrid GNN
Source code summarization aims to generate natural language summaries from structured code snippets for better understanding code functionalities. However, automatic code summarization is challenging due to the complexit…
Code SummarizationRetrievalRetrieval-augmented GenerationSource Code SummarizationBuilding A Coding Assistant via the Retrieval-Augmented Language Model
Pretrained language models have shown strong effectiveness in code-related tasks, such as code retrieval, code generation, code summarization, and code completion tasks. In this paper, we propose COde assistaNt viA retri…
Code CompletionCode GenerationCode SummarizationLanguage Modeling+3Retrieval Augmented Generation and Representative Vector Summarization for large unstructured textual data in Medical Education
Large Language Models are increasingly being used for various tasks including content generation and as chatbots. Despite their impressive performances in general tasks, LLMs need to be aligned when applying for domain s…
Abstractive Text SummarizationHallucinationRAGRetrieval+1Towards a Robust Retrieval-Based Summarization System
This paper describes an investigation of the robustness of large language models (LLMs) for retrieval augmented generation (RAG)-based summarization tasks. While LLMs provide summarization capabilities, their performance…
RAGRetrievalRetrieval-augmented GenerationTram: A Token-level Retrieval-augmented Mechanism for Source Code Summarization
Automatically generating human-readable text describing the functionality of a program is the intent of source code summarization. Although neural language models achieve significant performance in this field, they are l…
Code SummarizationDecoderRetrievalSentence+1