paper-with-me

Papers

MPFlow: Learning Budgeted Max-Flow Optimization on the Lightning Network with Deep Graph Reinforcement Learning

2026-07-09 · Harrison Rush, Vincent Davis, Simone Antonelli, Vikash Singh, Jesse Shrader, Emanuele Rossi arxiv

We address liquidity placement in the Bitcoin Lightning Network (LN): given a fixed budget, which channels should a node open to maximize its routing capacity? We cast this as a budget-constrained combinatorial optimization problem on graphs, selecting $k$ edge additions that maximize $s$--$t$ max-flow, a theory-grounded measure of routing capacity, and solve it with graph reinforcement learning. Our lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum: the network's top hubs are removed from training subgraphs, forcing the policy to learn capacity-aware placement rather than hub attachment. In extensive experiments on real Lightning Network snapshots, our method consistently outperforms strong heuristic baselines on the max-flow objective across multiple seeds and unseen graphs. The agent has been deployed in production for peer recommendations, executing 4640 channel-open decisions that cumulatively allocate 267.3 BTC over $16 million across 30 managed nodes.

📄 PDF Abstract BibTeX arXiv:2607.08703

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

RMP2: A Structured Composable Policy Class for Robot Learning

2021-03-10 · Anqi Li, Ching-An Cheng, M. Asif Rana, Man Xie 외

We consider the problem of learning motion policies for acceleration-based robotics systems with a structured policy class specified by RMPflow. RMPflow is a multi-task control framework that has been successfully applie…

Computational Efficiency

Implicit Normalizing Flows

2021-03-17 · ICLR 2021 1 · Cheng Lu, Jianfei Chen, Chongxuan Li, Qiuhao Wang 외

Normalizing flows define a probability distribution by an explicit invertible transformation $\boldsymbol{\mathbf{z}}=f(\boldsymbol{\mathbf{x}})$. In this work, we present implicit normalizing flows (ImpFlows), which gen…

Riemannian Motion Policy Fusion through Learnable Lyapunov Function Reshaping

2019-10-07 · Mustafa Mukadam, Ching-An Cheng, Dieter Fox, Byron Boots 외

RMPflow is a recently proposed policy-fusion framework based on differential geometry. While RMPflow has demonstrated promising performance, it requires the user to provide sensible subtask policies as Riemannian motion …

Imitation Learning

TempFlow-GRPO: When Timing Matters for GRPO in Flow Models

2025-08-06 · Xiaoxuan He, Siming Fu, Yuke Zhao, Wanli Li 외 arxiv

Recent flow matching models for text-to-image generation have achieved remarkable quality, yet their integration with reinforcement learning for human preference alignment remains suboptimal, hindering fine-grained rewar…

Text-to-Image GenerationReinforcement Learning

Symplectic Neural Flows for Modeling and Discovery

2024-12-21 · Priscilla Canizares, Davide Murari, Carola-Bibiane Schönlieb, Ferdia Sherry 외

Hamilton's equations are fundamental for modeling complex physical systems, where preserving key properties such as energy and momentum is crucial for reliable long-term simulations. Geometric integrators are widely used…