paper-with-me

홈 › Papers

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code

2026-05-06 · Kaifeng He, Xiaojun Zhang, Peiliang Cai, Mingwei Liu, Yanlin Wang, Chong Wang, Kaifeng Huang, Bihuan Chen, Xin Peng, Zibin Zheng arxiv

Large language models (LLMs) frequently generate defective outputs in code generation tasks, ranging from logical bugs to security vulnerabilities. While these generation failures are often treated as model-level limitations, empirical evidence increasingly traces their root causes to imperfections within the training corpora. Yet, the specific mechanisms linking training data quality issues to generated code quality issues remain largely unmapped. This paper presents a systematic literature review of 114 primary studies to investigate how training data quality issues propagate into code generation. We establish a unified taxonomy that categorizes generated code quality issues across nine dimensions and training data quality issues into code and non-code attributes. Based on this taxonomy, we formalize a causal framework detailing 18 typical propagation mapping mechanisms. Furthermore, we synthesize state-of-the-art detection and mitigation techniques across the data, model, and generation lifecycles. The reviewed literature reveals a clear methodological shift: quality assurance is transitioning from reactive, heuristic-based post-generation filtering toward proactive, data-centric governance and closed-loop repair. Finally, we identify open challenges and outline research directions for developing reliable LLMs for code through integrated data curation and continuous evaluation. Our repository is available at https://github.com/SYSUSELab/From-Data-to-Code.

📄 PDF Abstract BibTeX arXiv:2605.05267

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Similar Papers 제목 키워드 기반

Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications

2025-11-11 · Hai-Long Qin, Jincheng Dai, Guo Lu, Shuo Shao 외 arxiv

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has ca…

Domain Adaptation

AI-powered Contextual 3D Environment Generation: A Systematic Review

2025-06-05 · Miguel Silva, Alexandre Valle de Carvalho

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systemat…

Scene GenerationText to 3D

Combining Large Language Models with Static Analyzers for Code Review Generation

2025-02-10 · Imen Jaoua, Oussama Ben Sghaier, Houari Sahraoui

Code review is a crucial but often complex, subjective, and time-consuming activity in software development. Over the past decades, significant efforts have been made to automate this process. Early approaches focused on…

RAGRetrieval-augmented GenerationReview Generation

A Systematic Review of Data-to-Text NLG

2024-02-13 · Chinonso Cynthia Osuji, Thiago castro Ferreira, Brian Davis

This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datase…

Data-to-Text GenerationHallucinationRe-RankingText Generation

Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis

2025-08-06 · Linqing Chen, Hanmeng Zhong, Wentao Wu, Weilei Wang arxiv

Large language model (LLM) training faces a critical bottleneck: the scarcity of high-quality, reasoning-intensive question-answer pairs, especially from sparse, domain-specific sources like PubMed papers or legal docume…

Question Generation