paper-with-me

Papers

Ecomap: Sustainability-Driven Optimization of Multi-Tenant DNN Execution on Edge Servers

2025-03-06 · Varatheepan Paramanayakam, Andreas Karatzas, Dimitrios Stamoulis, Iraklis Anagnostopoulos

Edge computing systems struggle to efficiently manage multiple concurrent deep neural network (DNN) workloads while meeting strict latency requirements, minimizing power consumption, and maintaining environmental sustainability. This paper introduces Ecomap, a sustainability-driven framework that dynamically adjusts the maximum power threshold of edge devices based on real-time carbon intensity. Ecomap incorporates the innovative use of mixed-quality models, allowing it to dynamically replace computationally heavy DNNs with lighter alternatives when latency constraints are violated, ensuring service responsiveness with minimal accuracy loss. Additionally, it employs a transformer-based estimator to guide efficient workload mappings. Experimental results using NVIDIA Jetson AGX Xavier demonstrate that Ecomap reduces carbon emissions by an average of 30% and achieves a 25% lower carbon delay product (CDP) compared to state-of-the-art methods, while maintaining comparable or better latency and power efficiency.

📄 PDF Abstract BibTeX arXiv:2503.04148

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computing

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Segmentation of arbitrary features in very high resolution remote sensing imagery

2024-12-20 · Henry Cording, Yves Plancherel, Pablo Brito-Parada

Very high resolution (VHR) mapping through remote sensing (RS) imagery presents a new opportunity to inform decision-making and sustainable practices in countless domains. Efficient processing of big VHR data requires au…

Decision Making

Multi-Tenant Optimization For Few-Shot Task-Oriented FAQ Retrieval

2023-01-25 · Asha Vishwanathan, Rajeev Unnikrishnan Warrier, Gautham Vadakkekara Suresh, Chandra Shekhar Kandpal

Business-specific Frequently Asked Questions (FAQ) retrieval in task-oriented dialog systems poses unique challenges vis-\`a-vis community based FAQs. Each FAQ question represents an intent which is usually an umbrella t…

Intent DetectionRetrievalSentence

A Collaborative PIM Computing Optimization Framework for Multi-Tenant DNN

2024-08-09 · Bojing Li, Duo Zhong, Xiang Chen, ChenChen Liu

Modern Artificial Intelligence (AI) applications are increasingly utilizing multi-tenant deep neural networks (DNNs), which lead to a significant rise in computing complexity and the need for computing parallelism. ReRAM…

Data-Driven Adaptive Network Slicing for Multi-Tenant Networks

2021-06-07 · Navid Reyhanian, Zhi-Quan Luo

Network slicing to support multi-tenancy plays a key role in improving the performance of 5G networks. In this paper, we propose a two time-scale framework for the reservation-based network slicing in the backhaul and Ra…

A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs

2022-01-10 · Ruofan Liang, Bingsheng He, Shengen Yan, Peng Sun

Multi-tenant machine learning services have become emerging data-intensive workloads in data centers with heavy usage of GPU resources. Due to the large scale, many tuning parameters and heavy resource usage, it is usual…

BIG-bench Machine LearningGPUScheduling