Simulating Performance of ML Systems with Offline Profiling
We advocate that simulation based on offline profiling is a promising approach to better understand and improve the complex ML systems. Our approach uses operation-level profiling and dataflow based simulation to ensure it offers a unified and automated solution for all frameworks and ML models, and is also accurate by considering the various parallelization strategies in a real system.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems
Evaluating and iterating upon recommender systems is crucial, yet traditional A/B testing is resource-intensive, and offline methods struggle with dynamic user-platform interactions. While agent-based simulation is promi…
Recommendation SystemsLearning to Build User-tag Profile in Recommendation System (UTPM)
User profiling is one of the most important components in recommendation systems, where a user is profiled using demographic (e.g. gender, age, and location) and user behavior information (e.g. browsing and search histor…
Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRecommendation SystemsTAGVineLM: Trie-Based Fine-Grained Control for Agentic Workflows
Agentic workflows interleave configurable LLM stages with tool stages and often include retries or refinement loops. Existing workflow managers profile full workflow configurations offline and assign each request a stati…
Enhancing Conversational Agents via Task-Oriented Adversarial Memory Adaptation
Conversational agents struggle to handle long conversations due to context window limitations. Therefore, memory systems are developed to leverage essential historical information. Existing memory systems typically follo…
Covariance-Guided Resource Adaptive Learning for Efficient Edge Inference
For deep learning inference on edge devices, hardware configurations achieving the same throughput can differ by 2$\times$ in power consumption, yet operators often struggle to find the efficient ones without exhaustive …
Object Detection