Exploring Techniques for the Analysis of Spontaneous Asynchronicity in MPI-Parallel Applications
This paper studies the utility of using data analytics and machine learning techniques for identifying, classifying, and characterizing the dynamics of large-scale parallel (MPI) programs. To this end, we run microbenchmarks and realistic proxy applications with the regular compute-communicate structure on two different supercomputing platforms and choose the per-process performance and MPI time per time step as relevant observables. Using principal component analysis, clustering techniques, correlation functions, and a new "phase space plot," we show how desynchronization patterns (or lack thereof) can be readily identified from a data set that is much smaller than a full MPI trace. Our methods also lead the way towards a more general classification of parallel program dynamics.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringGeneral ClassificationSimilar Papers 제목 키워드 기반
Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with…
Graph ClassificationLink PredictionNode ClassificationPipelined Backpropagation at Scale: Training Large Models without Batches
New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to explore the hardware and machine learning pr…
Image ClassificationStochastic OptimizationSpontaneous segregation of visual information between parallel streams of a multi-stream convolutional neural network
Visual information is processed in hierarchically organized parallel pathways in the primate brain. In lower cortical areas, color information and shape information are processed in a parallel manner, while in higher cor…
Exploring Novel Object Recognition and Spontaneous Location Recognition Machine Learning Analysis Techniques in Alzheimer's Mice
Understanding object recognition patterns in mice is crucial for advancing behavioral neuroscience and has significant implications for human health, particularly in the realm of Alzheimer's research. This study is cente…
Object RecognitionPose EstimationExploring End-to-End Techniques for Low-Resource Speech Recognition
In this work we present simple grapheme-based system for low-resource speech recognition using Babel data for Turkish spontaneous speech (80 hours). We have investigated different neural network architectures performance…
speech-recognitionSpeech Recognition