Transfer Learning for Performance Modeling of Configurable Systems: A Causal Analysis
Modern systems (e.g., deep neural networks, big data analytics, and compilers) are highly configurable, which means they expose different performance behavior under different configurations. The fundamental challenge is that one cannot simply measure all configurations due to the sheer size of the configuration space. Transfer learning has been used to reduce the measurement efforts by transferring knowledge about performance behavior of systems across environments. Previously, research has shown that statistical models are indeed transferable across environments. In this work, we investigate identifiability and transportability of causal effects and statistical relations in highly-configurable systems. Our causal analysis agrees with previous exploratory analysis \cite{Jamshidi17} and confirms that the causal effects of configuration options can be carried over across environments with high confidence. We expect that the ability to carry over causal relations will enable effective performance analysis of highly-configurable systems.
Code (1)
Tasks
Transfer LearningSimilar Papers 제목 키워드 기반
Unicorn: Reasoning about Configurable System Performance through the lens of Causality
Modern computer systems are highly configurable, with the total variability space sometimes larger than the number of atoms in the universe. Understanding and reasoning about the performance behavior of highly configurab…
BIG-bench Machine LearningCausal InferenceManagementCURE: Simulation-Augmented Auto-Tuning in Robotics
Robotic systems are typically composed of various subsystems, such as localization and navigation, each encompassing numerous configurable components (e.g., selecting different planning algorithms). Once an algorithm has…
Bayesian OptimizationAdditive Causal Construction for Transferable and Reconfigurable Cross-System Learning in Multi-Source Image Fusion
In multi-source image fusion scenarios, heterogeneous inputs are typically driven by distinct generative mechanisms and can be viewed as a composition of multiple causal systems. However, cross-system discrepancy (CSD) a…
Representation LearningCaRE: Finding Root Causes of Configuration Issues in Highly-Configurable Robots
Robotic systems have subsystems with a combinatorially large configuration space and hundreds or thousands of possible software and hardware configuration options interacting non-trivially. The configurable parameters ar…
Transfer Learning for Performance Modeling of Deep Neural Network Systems
Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance mode…
Transfer Learning