paper-with-me

Papers

NARRepair: Non-Autoregressive Code Generation Model for Automatic Program Repair

2024-06-24 · Zhenyu Yang, Zhen Yang, Zhongxing Yu

With the advancement of deep learning techniques, the performance of Automatic Program Repair(APR) techniques has reached a new level. Previous deep learning-based APR techniques essentially modified program sentences in the Autoregressive(AR) manner, which predicts future values based on past values. Due to the manner of word-by-word generation, the AR-based APR technique has a huge time delay. This negative consequence overshadows the widespread adoption of APR techniques in real-life software development. To address the issue, we aim to apply the Non-Autoregressive(NAR) method to the APR task, which can output target code in a parallel manner to avoid huge inference delays. To effectively adapt the NAR manner for the APR task, we in this paper propose NARRepair, the first customized NAR code generation model for the APR task. The NARRepair features three major novelties, including 1) using repair actions to alleviate the over-correction issue, 2) extracting dependency information from AST to alleviate the issue of lacking inter-word dependency information, 3) employing two-stage decoding to alleviate the issue of lacking contextual information. We evaluated NARRepair on three widely used datasets in the APR community, and the results show that our technique can significantly improve the inference speed while maintaining high repair accuracy.

📄 PDF Abstract BibTeX arXiv:2406.16526

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationProgram Repair

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering

2022-11-07 · Tengxun Zhang, Hongfei Xu, Josef van Genabith, Deyi Xiong 외

Hybrid tabular-textual question answering (QA) requires reasoning from heterogeneous information, and the types of reasoning are mainly divided into numerical reasoning and span extraction. Current numerical reasoning me…

Question Answering

Sequence-to-Lattice Models for Fast Translation

2021-11-01 · Findings (EMNLP) 2021 11 · Yuntian Deng, Alexander Rush

Non-autoregressive machine translation (NAT) approaches enable fast generation by utilizing parallelizable generative processes. The remaining bottleneck in these models is their decoder layers; unfortunately unlike in a…

DecoderMachine TranslationTranslation

Beyond Autoregression: An Empirical Study of Diffusion Large Language Models for Code Generation

2025-09-14 · Chengze Li, Yitong Zhang, Jia Li, Liyi Cai 외 arxiv

LLMs have become the mainstream approaches to code generation. Existing LLMs mainly employ autoregressive generation, i.e. generating code token-by-token from left to right. However, the underlying autoregressive generat…

Code Generation

AnCoder: Anchored Code Generation via Discrete Diffusion Models

2026-02-05 · Anton Xue, Litu Rout, Constantine Caramanis, Sanjay Shakkottai arxiv

Diffusion language models offer a compelling alternative to autoregressive code generation, enabling global planning and iterative refinement of complex program logic. However, existing approaches fail to respect the rig…

Code Generation

Constrained Code Generation with Discrete Diffusion

2026-05-16 · Lize Shao, Michael Cardei, Zichen Xie, Ferdinando Fioretto 외 arxiv

Discrete diffusion models are a powerful, emerging paradigm for code generation. They construct programs through iterative refinement of partially corrupted token sequences and enable parallel token refinement. Important…

Code Generation