Exploring Data Augmentation for Code Generation Tasks
Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and expanded it through multi-modality and multi-tasking, yet the data for downstream tasks remain modest in size. Focusing on data utilization for downstream tasks, we propose and adapt augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. Further analysis suggests that our methods work orthogonally and show benefits in output code style and numeric consistency. We also discuss test data imperfections.
Code (1)
Tasks
Code GenerationCode SummarizationCode TranslationData AugmentationProgram SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VulScribeR: Exploring RAG-based Vulnerability Augmentation with LLMs
Detecting vulnerabilities is vital for software security, yet deep learning-based vulnerability detectors (DLVD) face a data shortage, which limits their effectiveness. Data augmentation can potentially alleviate the dat…
Code GenerationData AugmentationRAGRetrieval-augmented Generation+1Exploring Transformer Text Generation for Medical Dataset Augmentation
Natural Language Processing (NLP) can help unlock the vast troves of unstructured data in clinical text and thus improve healthcare research. However, a big barrier to developments in this field is data access due to pat…
Synthetic Data GenerationText GenerationExploring Variational Autoencoders for Medical Image Generation: A Comprehensive Study
Variational autoencoder (VAE) is one of the most common techniques in the field of medical image generation, where this architecture has shown advanced researchers in recent years and has developed into various architect…
Data AugmentationDiversityImage GenerationMedical Image GenerationVACoDe: Visual Augmented Contrastive Decoding
Despite the astonishing performance of recent Large Vision-Language Models (LVLMs), these models often generate inaccurate responses. To address this issue, previous studies have focused on mitigating hallucinations by e…
SE-VGAE: Unsupervised Disentangled Representation Learning for Interpretable Architectural Layout Design Graph Generation
Despite the suitability of graphs for capturing the relational structures inherent in architectural layout designs, there is a notable dearth of research on interpreting architectural design space using graph-based repre…
DecoderDisentanglementGraph GenerationLayout Design+1