paper-with-me

Papers

Retrieval-Augmented Generation for Code Summarization via Hybrid GNN

2020-06-09 · ICLR 2021 1 · Shangqing Liu, Yu Chen, Xiaofei Xie, JingKai Siow, Yang Liu

Source code summarization aims to generate natural language summaries from structured code snippets for better understanding code functionalities. However, automatic code summarization is challenging due to the complexity of the source code and the language gap between the source code and natural language summaries. Most previous approaches either rely on retrieval-based (which can take advantage of similar examples seen from the retrieval database, but have low generalization performance) or generation-based methods (which have better generalization performance, but cannot take advantage of similar examples). This paper proposes a novel retrieval-augmented mechanism to combine the benefits of both worlds. Furthermore, to mitigate the limitation of Graph Neural Networks (GNNs) on capturing global graph structure information of source code, we propose a novel attention-based dynamic graph to complement the static graph representation of the source code, and design a hybrid message passing GNN for capturing both the local and global structural information. To evaluate the proposed approach, we release a new challenging benchmark, crawled from diversified large-scale open-source C projects (total 95k+ unique functions in the dataset). Our method achieves the state-of-the-art performance, improving existing methods by 1.42, 2.44 and 1.29 in terms of BLEU-4, ROUGE-L and METEOR.

📄 PDF Abstract BibTeX arXiv:2006.05405

Code (1)

shangqing-liu/CCSD-benchmark-for-code-summarization 공식 구현

Tasks

Code SummarizationRetrievalRetrieval-augmented GenerationSource Code Summarization

Similar Papers 제목 키워드 기반

Retrieval Augmented Code Generation and Summarization

2021-08-26 · Findings (EMNLP) 2021 11 · Md Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray 외

Software developers write a lot of source code and documentation during software development. Intrinsically, developers often recall parts of source code or code summaries that they had written in the past while implemen…

Code GenerationCode SummarizationRetrieval

Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization

2025-04-17 · Adithya Pratapa, Teruko Mitamura

Recent advances in long-context reasoning abilities of language models led to interesting applications in large-scale multi-document summarization. However, prior work has shown that these long-context models are not eff…

Document SummarizationMulti-Document SummarizationRAGRetrieval

Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generation

2026-05-01 · Ziwen Zhao, Menglin Yang arxiv

Retrieval-augmented generation (RAG) enhances large language models with external knowledge, and tree-based RAG organizes documents into hierarchical indexes to support queries at multiple granularities. However, existin…

Question Answering

Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering

2025-09-28 · Muhammad Abu Ahmad, Mohamad Ballout, Raia Abu Ahmad, Elia Bruni arxiv

This paper presents our submission to the QIAS 2025 shared task on Islamic knowledge understanding and reasoning. We developed a hybrid retrieval-augmented generation (RAG) system that combines sparse and dense retrieval…

Question Answering

Building A Coding Assistant via the Retrieval-Augmented Language Model

2024-10-21 · Xinze Li, Hanbin Wang, Zhenghao Liu, Shi Yu 외

Pretrained language models have shown strong effectiveness in code-related tasks, such as code retrieval, code generation, code summarization, and code completion tasks. In this paper, we propose COde assistaNt viA retri…

Code CompletionCode GenerationCode SummarizationLanguage Modeling+3