A Unified Active Learning Framework for Annotating Graph Data with Application to Software Source Code Performance Prediction
Most machine learning and data analytics applications, including performance engineering in software systems, require a large number of annotations and labelled data, which might not be available in advance. Acquiring annotations often requires significant time, effort, and computational resources, making it challenging. We develop a unified active learning framework specializing in software performance prediction to address this task. We begin by parsing the source code to an Abstract Syntax Tree (AST) and augmenting it with data and control flow edges. Then, we convert the tree representation of the source code to a Flow Augmented-AST graph (FA-AST) representation. Based on the graph representation, we construct various graph embeddings (unsupervised and supervised) into a latent space. Given such an embedding, the framework becomes task agnostic since active learning can be performed using any regression method and query strategy suited for regression. Within this framework, we investigate the impact of using different levels of information for active and passive learning, e.g., partially available labels and unlabeled test data. Our approach aims to improve the investment in AI models for different software performance predictions (execution time) based on the structure of the source code. Our real-world experiments reveal that respectable performance can be achieved by querying labels for only a small subset of all the data.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Tyger: Task-Type-Generic Active Learning for Molecular Property Prediction
How to accurately predict the properties of molecules is an essential problem in AI-driven drug discovery, which generally requires a large amount of annotation for training deep learning models. Annotating molecules, ho…
Active LearningDrug DiscoveryMolecular Property PredictionProperty Prediction+1Towards Unification of Discourse Annotation Frameworks
Discourse information is difficult to represent and annotate. Among the major frameworks for annotating discourse information, RST, PDTB and SDRT are widely discussed and used, each having its own theoretical foundation …
Multi-Task LearningInteractive Annotation of 3D Object Geometry using 2D Scribbles
Inferring detailed 3D geometry of the scene is crucial for robotics applications, simulation, and 3D content creation. However, such information is hard to obtain, and thus very few datasets support it. In this paper, we…
3D geometryA Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Study
We present a detailed replication study of the BASS framework, an abstractive summarization system based on the notion of Unified Semantic Graphs. Our investigation includes challenges in replicating key components and a…
Abstractive Text SummarizationBASS: Boosting Abstractive Summarization with Unified Semantic Graph
Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a novel…
Abstractive Text SummarizationDecoderDocument SummarizationImplicit Relations+1