Seemless Utilization of Heterogeneous XSede Resources to Accelerate Processing of a High Value Functional Neuroimaging Dataset
We describe the technical effort used to process a voluminous high value human neuroimaging dataset on the Open Science Grid with opportunistic use of idle HPC resources to boost computing capacity more than 5-fold. With minimal software development effort and no discernable competitive interference with other HPC users, this effort delivered 15,000,000 core hours over 7 months.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
ABS-SGD: A Delayed Synchronous Stochastic Gradient Descent Algorithm with Adaptive Batch Size for Heterogeneous GPU Clusters
As the size of models and datasets grows, it has become increasingly common to train models in parallel. However, existing distributed stochastic gradient descent (SGD) algorithms suffer from insufficient utilization of …
GPUHeterogeneous CPU+GPU Stochastic Gradient Descent Algorithms
The widely-adopted practice is to train deep learning models with specialized hardware accelerators, e.g., GPUs or TPUs, due to their superior performance on linear algebra operations. However, this strategy does not emp…
CPUDeep LearningGPUSchedulingPiPar: Pipeline Parallelism for Collaborative Machine Learning
Collaborative machine learning (CML) techniques, such as federated learning, have been proposed to train deep learning models across multiple mobile devices and a server. CML techniques are privacy-preserving as a local …
Federated LearningPrivacy PreservingResource Heterogeneity-Aware and Utilization-Enhanced Scheduling for Deep Learning Clusters
Scheduling deep learning (DL) models to train on powerful clusters with accelerators like GPUs and TPUs, presently falls short, either lacking fine-grained heterogeneity awareness or leaving resources substantially under…
SchedulingNEMAR: An open access data, tools, and compute resource operating on NeuroElectroMagnetic data
To take advantage of recent and ongoing advances in large-scale computational methods, and to preserve the scientific data created by publicly funded research projects, data archives must be created as well as standards …
EEGElectroencephalogram (EEG)