HiQ -- A Declarative, Non-intrusive, Dynamic and Transparent Observability and Optimization System
This paper proposes a non-intrusive, declarative, dynamic and transparent system called HiQ to track Python program runtime information without compromising on the run-time system performance and losing insight. HiQ can be used for monolithic and distributed systems, offline and online applications. HiQ is developed when we optimize our large deep neural network (DNN) models which are written in Python, but it can be generalized to any Python program or distributed system, or even other languages like Java. We have implemented the system and adopted it in our deep learning model life cycle management system to catch the bottleneck while keeping our production code clean and highly performant. The implementation is open-sourced at: https://github.com/oracle/hiq.
Code (1)
Tasks
ManagementSimilar Papers 제목 키워드 기반
Toward Adaptive Non-Intrusive Reduced-Order Models: Design and Challenges
Projection-based Reduced Order Models (ROMs) are often deployed as static surrogates, which limits their practical utility once a system leaves the training manifold. We formalize and study adaptive non-intrusive ROMs th…
Streamlining Knowledge Graph Creation with PyRML
Knowledge Graphs (KGs) are increasingly adopted as a foundational technology for integrating heterogeneous data in domains such as climate science, cultural heritage, and the life sciences. Declarative mapping languages …
Data IntegrationKnowledge GraphsTowards Generating Explanations for ASP-Based Link Analysis using Declarative Program Transformations
The explication and the generation of explanations are prominent topics in artificial intelligence and data science, in order to make methods and systems more transparent and understandable for humans. This paper investi…
Link PredictionPredictionOxyGent: Making Multi-Agent Systems Modular, Observable, and Evolvable via Oxy Abstraction
Deploying production-ready multi-agent systems (MAS) in complex industrial environments remains challenging due to limitations in scalability, observability, and autonomous evolution. We present OxyGent, an open-source f…
Learning Abduction under Partial Observability
Juba recently proposed a formulation of learning abductive reasoning from examples, in which both the relative plausibility of various explanations, as well as which explanations are valid, are learned directly from data…
valid