paper-with-me

Papers

Scalable Cosmic AI Inference using Cloud Serverless Computing with FMI

2025-01-08 · Mills Staylor, Amirreza Dolatpour Fathkouhi, Md Khairul Islam, Kaleigh O'Hara, Ryan Ghiles Goudjil, Geoffrey Fox, Judy Fox

Large-scale astronomical image data processing and prediction is essential for astronomers, providing crucial insights into celestial objects, the universe's history, and its evolution. While modern deep learning models offer high predictive accuracy, they often demand substantial computational resources, making them resource-intensive and limiting accessibility. We introduce the Cloud-based Astronomy Inference (CAI) framework to address these challenges. This scalable solution integrates pre-trained foundation models with serverless cloud infrastructure through a Function-as-a-Service (FaaS) Message Interface (FMI). CAI enables efficient and scalable inference on astronomical images without extensive hardware. Using a foundation model for redshift prediction as a case study, our extensive experiments cover user devices, HPC (High-Performance Computing) servers, and Cloud. CAI's significant scalability improvement on large data sizes provides an accessible and effective tool for the astronomy community. The code is accessible at https://github.com/UVA-MLSys/AI-for-Astronomy.

📄 PDF Abstract BibTeX arXiv:2501.06249

Code (1)

UVA-MLSys/AI-for-Astronomy 공식 구현 pytorch

Tasks

Astronomy

Similar Papers 제목 키워드 기반

FSD-Inference: Fully Serverless Distributed Inference with Scalable Cloud Communication

2024-03-22 · Joe Oakley, Hakan Ferhatosmanoglu

Serverless computing offers attractive scalability, elasticity and cost-effectiveness. However, constraints on memory, CPU and function runtime have hindered its adoption for data-intensive applications and machine learn…

CPU

Serverless computing provides on-demand high performance computing for biomedical research

2018-07-31 · Dimitar Kumanov, Ling-Hong Hung, Wes Lloyd, Ka Yee Yeung

Cloud computing offers on-demand, scalable computing and storage, and has become an essential resource for the analyses of big biomedical data. The usual approach to cloud computing requires users to reserve and provisio…

AllCloud ComputingVocal Bursts Intensity Prediction

Distributed Double Machine Learning with a Serverless Architecture

2021-01-11 · Malte S. Kurz

This paper explores serverless cloud computing for double machine learning. Being based on repeated cross-fitting, double machine learning is particularly well suited to exploit the high level of parallelism achievable w…

BIG-bench Machine LearningCloud Computing

MLProxy: SLA-Aware Reverse Proxy for Machine Learning Inference Serving on Serverless Computing Platforms

2022-02-23 · Nima Mahmoudi, Hamzeh Khazaei

Serving machine learning inference workloads on the cloud is still a challenging task on the production level. Optimal configuration of the inference workload to meet SLA requirements while optimizing the infrastructure …

BIG-bench Machine LearningManagement

Serverless AI Security: Attack Surface Analysis and Runtime Protection Mechanisms for FaaS-Based Machine Learning

2026-01-15 · Chetan Pathade, Vinod Dhimam, Sheheryar Ahmad, Ilsa Lareb arxiv

Serverless computing has achieved widespread adoption, with over 70% of AWS organizations using serverless solutions [1]. Meanwhile, machine learning inference workloads increasingly migrate to Function-as-a-Service (Faa…