Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native
In this paper, we investigate the intersection of large generative AI models and cloud-native computing architectures. Recent large models such as ChatGPT, while revolutionary in their capabilities, face challenges like escalating costs and demand for high-end GPUs. Drawing analogies between large-model-as-a-service (LMaaS) and cloud database-as-a-service (DBaaS), we describe an AI-native computing paradigm that harnesses the power of both cloud-native technologies (e.g., multi-tenancy and serverless computing) and advanced machine learning runtime (e.g., batched LoRA inference). These joint efforts aim to optimize costs-of-goods-sold (COGS) and improve resource accessibility. The journey of merging these two domains is just at the beginning and we hope to stimulate future research and development in this area.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
NetGPT: A Native-AI Network Architecture Beyond Provisioning Personalized Generative Services
Large language models (LLMs) have triggered tremendous success to empower our daily life by generative information. The personalization of LLMs could further contribute to their applications due to better alignment with …
Comparative Analysis of Methods for Cloud Segmentation in Ground-Based Infrared Images
The increasing penetration of photovoltaic systems in the power grid makes it vulnerable to cloud shadow projection. Real-time cloud segmentation in ground-based infrared images is important to reduce the noise in intra-…
SegmentationSolar Irradiance ForecastingSmaller, Smarter, Closer: The Edge of Collaborative Generative AI
The rapid adoption of generative AI (GenAI), particularly Large Language Models (LLMs), has exposed critical limitations of cloud-centric deployments, including latency, cost, and privacy concerns. Meanwhile, Small Langu…
Collaborative InferenceDiscriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks
We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task, instead of relying on hand-engineered representations. Our framework is modul…
Deep Reinforcement Learning Based Resource Allocation for Cloud Native Wireless Network
Cloud native technology has revolutionized 5G beyond and 6G communication networks, offering unprecedented levels of operational automation, flexibility, and adaptability. However, the vast array of cloud native services…
Cloud ComputingDeep Reinforcement LearningEdge-computingreinforcement-learning