paper-with-me

Papers

Predicting Execution Time of Computer Programs Using Sparse Polynomial Regression

2010-12-01 · NeurIPS 2010 12 · Ling Huang, Jinzhu Jia, Bin Yu, Byung-Gon Chun, Petros Maniatis, Mayur Naik

Predicting the execution time of computer programs is an important but challenging problem in the community of computer systems. Existing methods require experts to perform detailed analysis of program code in order to construct predictors or select important features. We recently developed a new system to automatically extract a large number of features from program execution on sample inputs, on which prediction models can be constructed without expert knowledge. In this paper we study the construction of predictive models for this problem. We propose the SPORE (Sparse POlynomial REgression) methodology to build accurate prediction models of program performance using feature data collected from program execution on sample inputs. Our two SPORE algorithms are able to build relationships between responses (e.g., the execution time of a computer program) and features, and select a few from hundreds of the retrieved features to construct an explicitly sparse and non-linear model to predict the response variable. The compact and explicitly polynomial form of the estimated model could reveal important insights into the computer program (e.g., features and their non-linear combinations that dominate the execution time), enabling a better understanding of the program’s behavior. Our evaluation on three widely used computer programs shows that SPORE methods can give accurate prediction with relative error less than 7% by using a moderate number of training data samples. In addition, we compare SPORE algorithms to state-of-the-art sparse regression algorithms, and show that SPORE methods, motivated by real applications, outperform the other methods in terms of both interpretability and prediction accuracy.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Predictionregression

Similar Papers 제목 키워드 기반

New approach to MPI program execution time prediction

2020-07-30 · A. Chupakhin, A. Kolosov, R. Smeliansky, V. Antonenko 외

The problem of MPI programs execution time prediction on a certain set of computer installations is considered. This problem emerges with orchestration and provisioning a virtual infrastructure in a cloud computing envir…

ArticlesCloud ComputingPredictionRecommendation Systems

Training Transformers as a Universal Computer

2026-04-28 · Ruize Xu, Chenxiao Yang, Yanhong Li, David McAllester arxiv

We demonstrate that a small transformer can learn to execute programs in MicroPy, a simplified yet computationally universal programming language. Given procedure definitions together with an expression to evaluate, the …

Predicting Performance of Symbolic and Prompt Programs with Examples

2026-05-15 · Chengqi Zheng, Keya Hu, Shuzhi Liu, Tao Wu 외 arxiv

LLM prompting is widely used for naturally stated tasks, yet it is unreliable it may succeed on a few test cases but fail at deployment time. We study performance prediction: given a program, either symbolic (e.g. Python…

TEP-GNN: Accurate Execution Time Prediction of Functional Tests using Graph Neural Networks

2022-08-25 · Hazem Peter Samoaa, Antonio Longa, Mazen Mohamad, Morteza Haghir Chehreghani 외

Predicting the performance of production code prior to actually executing or benchmarking it is known to be highly challenging. In this paper, we propose a predictive model, dubbed TEP-GNN, which demonstrates that high-a…

BenchmarkingGraph Neural Network

ReGAL: Refactoring Programs to Discover Generalizable Abstractions

2024-01-29 · Elias Stengel-Eskin, Archiki Prasad, Mohit Bansal

While large language models (LLMs) are increasingly being used for program synthesis, they lack the global view needed to develop useful abstractions; they generally predict programs one at a time, often repeating the sa…

Date UnderstandingMathMinecraftProgram Synthesis