paper-with-me

홈 › Papers

Efficient Interaction-Aware Interval Analysis of Neural Network Feedback Loops

2023-07-27 · Saber Jafarpour, Akash Harapanahalli, Samuel Coogan

In this paper, we propose a computationally efficient framework for interval reachability of systems with neural network controllers. Our approach leverages inclusion functions for the open-loop system and the neural network controller to embed the closed-loop system into a larger-dimensional embedding system, where a single trajectory over-approximates the original system's behavior under uncertainty. We propose two methods for constructing closed-loop embedding systems, which account for the interactions between the system and the controller in different ways. The interconnection-based approach considers the worst-case evolution of each coordinate separately by substituting the neural network inclusion function into the open-loop inclusion function. The interaction-based approach uses novel Jacobian-based inclusion functions to capture the first-order interactions between the open-loop system and the controller by leveraging state-of-the-art neural network verifiers. Finally, we implement our approach in a Python framework called ReachMM to demonstrate its efficiency and scalability on benchmarks and examples ranging to $200$ state dimensions.

📄 PDF Abstract BibTeX arXiv:2307.14938

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Fast Feedback Control over Multi-hop Wireless Networks with Mode Changes and Stability Guarantees

2019-09-19

Closing feedback loops fast and over long distances is key to emerging cyber-physical applications; for example, robot motion control and swarm coordination require update intervals of tens of milliseconds. Low-power wir…

Feedback Loops With Language Models Drive In-Context Reward Hacking

2024-02-09 · Alexander Pan, Erik Jones, Meena Jagadeesan, Jacob Steinhardt

Language models influence the external world: they query APIs that read and write to web pages, generate content that shapes human behavior, and run system commands as autonomous agents. These interactions form feedback …

Analysis of hidden feedback loops in continuous machine learning systems

2021-01-14 · Anton Khritankov

In this concept paper, we discuss intricacies of specifying and verifying the quality of continuous and lifelong learning artificial intelligence systems as they interact with and influence their environment causing a so…

BIG-bench Machine LearningLifelong learning

Finding the Loops that Matter

2020-05-27 · Robert Eberlein, William Schoenberg

The Loops that Matter method (Schoenberg et. al, 2019) for understanding model behavior provides metrics showing the contribution of the feedback loops in a model to behavior at each point in time. To provide these metri…

A Bayesian Choice Model for Eliminating Feedback Loops

2019-08-15 · Gökhan Çapan, Ilker Gündoğdu, Ali Caner Türkmen, Çağrı Sofuoğlu 외

Self-reinforcing feedback loops in personalization systems are typically caused by users choosing from a limited set of alternatives presented systematically based on previous choices. We propose a Bayesian choice model …

Recommendation SystemsThompson Sampling