paper-with-me

Papers

Interactive Visualization for Debugging RL

2020-08-14 · Shuby Deshpande, Benjamin Eysenbach, Jeff Schneider

Visualization tools for supervised learning allow users to interpret, introspect, and gain an intuition for the successes and failures of their models. While reinforcement learning practitioners ask many of the same questions, existing tools are not applicable to the RL setting as these tools address challenges typically found in the supervised learning regime. In this work, we design and implement an interactive visualization tool for debugging and interpreting RL algorithms. Our system addresses many features missing from previous tools such as (1) tools for supervised learning often are not interactive; (2) while debugging RL policies researchers use state representations that are different from those seen by the agent; (3) a framework designed to make the debugging RL policies more conducive. We provide an example workflow of how this system could be used, along with ideas for future extensions.

📄 PDF Abstract BibTeX arXiv:2008.07331

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Interactive Debugging and Steering of Multi-Agent AI Systems

2025-03-03 · Will Epperson, Gagan Bansal, Victor Dibia, Adam Fourney 외

Fully autonomous teams of LLM-powered AI agents are emerging that collaborate to perform complex tasks for users. What challenges do developers face when trying to build and debug these AI agent teams? In formative inter…

AI Agent

Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training

2020-08-15 · Geoffrey X. Yu, Tovi Grossman, Gennady Pekhimenko

Training a state-of-the-art deep neural network (DNN) is a computationally-expensive and time-consuming process, which incentivizes deep learning developers to debug their DNNs for computational performance. However, eff…

Deep LearningDiagnostic

Interactive Prompt Debugging with Sequence Salience

2024-04-11 · Ian Tenney, Ryan Mullins, Bin Du, Shree Pandya 외

We present Sequence Salience, a visual tool for interactive prompt debugging with input salience methods. Sequence Salience builds on widely used salience methods for text classification and single-token prediction, and …

Sentencetext-classificationText Classification

DeepCAVE: A Visualization and Analysis Tool for Automated Machine Learning

2025-12-01 · Sarah Segel, Helena Graf, Edward Bergman, Kristina Thieme 외 arxiv

Hyperparameter optimization (HPO), as a central paradigm of AutoML, is crucial for leveraging the full potential of machine learning (ML) models; yet its complexity poses challenges in understanding and debugging the opt…

Hyperparameter Optimization

ModelWisdom: An Integrated Toolkit for TLA+ Model Visualization, Digest and Repair

2026-02-12 · Zhiyong Chen, Jialun Cao, Chang Xu, Shing-Chi Cheung arxiv

Model checking in TLA+ provides strong correctness guarantees, yet practitioners continue to face significant challenges in interpreting counterexamples, understanding large state-transition graphs, and repairing faulty …