paper-with-me

Papers

Program Structure-aware Language Models: Targeted Software Testing beyond Textual Semantics

2026-04-20 · Khang Tran, Khoa Nguyen, Cristian Borcea, NhatHai Phan arxiv

Recent advances in large language models for test case generation have improved branch coverage via prompt-engineered mutations. However, they still lack principled mechanisms for steering models toward specific high-risk execution branches, limiting their effectiveness for discovering subtle bugs and security vulnerabilities. We propose GLMTest, the first program structure-aware LLM framework for targeted test case generation that seamlessly integrates code property graphs and code semantics using a graph neural network and a language model to condition test case generation on execution branches. This structured conditioning enables controllable and branch-targeted test case generation, thereby potentially enhancing bug and security risk discovery. Experiments on real-world projects show that GLMTest built on a Qwen2.5-Coder-7B-Instruct model improves branch accuracy from 27.4% to 50.2% on TestGenEval benchmark compared with state-of-the-art LLMs, i.e., Claude-Sonnet-4.5 and GPT-4o-mini.

📄 PDF Abstract BibTeX arXiv:2604.17715

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Similar Papers 제목 키워드 기반

Interactive Evaluation of Large Language Models for Multi-Requirement Software Engineering Tasks

2025-08-26 · Dimitrios Rontogiannis, Maxime Peyrard, Nicolas Baldwin, Martin Josifoski 외 arxiv

Standard single-turn, static benchmarks fall short in evaluating the nuanced capabilities of Large Language Models (LLMs) on complex tasks such as software engineering. In this work, we propose a novel interactive evalua…

Syntax and Domain Aware Model for Unsupervised Program Translation

2023-02-08 · Fang Liu, Jia Li, Li Zhang

There is growing interest in software migration as the development of software and society. Manually migrating projects between languages is error-prone and expensive. In recent years, researchers have begun to explore a…

Cross-Lingual TransferTranslation

Learning Structure-Aware Representations of Dependent Types

2024-02-03 · Konstantinos Kogkalidis, Orestis Melkonian, Jean-Philippe Bernardy

Agda is a dependently-typed programming language and a proof assistant, pivotal in proof formalization and programming language theory. This paper extends the Agda ecosystem into machine learning territory, and, vice ver…

Introduction of an Assistance System to Support Domain Experts in Programming Low-code to Leverage Industry 5.0

2022-12-09 · Eva-Maria Neumann, Birgit Vogel-Heuser, Fabian Haben, Marius Krueger 외

The rapid technological leaps of Industry 4.0 increase the pressure and demands on humans working in automation, which is one of the main motivators of Industry 5.0. In particular, automation software development for mec…

Engineering Scientific Assistants using Interactive Structured Induction of Programs

2025-03-18 · Shraddha Surana, Ashwin Srinivasan

We are interested in the construction of software that can act as scientific assistants to domain specialists. It is expected that such assistants will be needed to accelerate the identification of ways to address comple…

Large Language Model