paper-with-me

Papers

C3: Learning Congestion Controllers with Formal Certificates

2024-12-14 · Chenxi Yang, Divyanshu Saxena, Rohit Dwivedula, Kshiteej Mahajan, Swarat Chaudhuri, Aditya Akella

Learning-based congestion controllers offer better adaptability compared to traditional heuristic algorithms. However, the inherent unreliability of learning techniques can cause learning-based controllers to behave poorly, creating a need for formal guarantees. While methods for formally verifying learned congestion controllers exist, these methods offer binary feedback that cannot optimize the controller toward better behavior. We improve this state-of-the-art via C3, a new learning framework for congestion control that integrates the concept of formal certification in the learning loop. C3 uses an abstract interpreter that can produce robustness and performance certificates to guide the training process, rewarding models that are robust and performant even on worst-case inputs. Our evaluation demonstrates that unlike state-of-the-art learned controllers, C3-trained controllers provide both adaptability and worst-case reliability across a range of network conditions.

📄 PDF Abstract BibTeX arXiv:2412.10915

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates

2024-05-22 · Udayan Mandal, Guy Amir, Haoze Wu, Ieva Daukantas 외

Deep reinforcement learning (DRL) is a powerful machine learning paradigm for generating agents that control autonomous systems. However, the ``black box'' nature of DRL agents limits their deployment in real-world safet…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

A General Framework for Verification and Control of Dynamical Models via Certificate Synthesis

2023-09-12 · Alec Edwards, Andrea Peruffo, Alessandro Abate

An emerging branch of control theory specialises in certificate learning, concerning the specification of a desired (possibly complex) system behaviour for an autonomous or control model, which is then analytically verif…

Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificates

2026-02-05 · Chengxiao Wang, Haoze Wu, Gagandeep Singh arxiv

Neural Lyapunov and barrier certificates have recently been used as powerful tools for verifying the safety and stability properties of deep reinforcement learning (RL) controllers. However, existing methods offer guaran…

Reinforcement Learning

From Small-Gain Theory to Compositional Construction of Barrier Certificates for Large-Scale Stochastic Systems

2021-01-18 · Mahathi Anand, Abolfazl Lavaei, Majid Zamani

This paper is concerned with a compositional approach for the construction of control barrier certificates for large-scale interconnected stochastic systems while synthesizing hybrid controllers against high-level logic …

Neural Proofs for Sound Verification and Control of Complex Systems

2025-12-20 · Alessandro Abate arxiv

This informal contribution presents an ongoing line of research that is pursuing a new approach to the construction of sound proofs for the formal verification and control of complex stochastic models of dynamical system…

Decision Making