paper-with-me

홈 › Papers

RLOR: A Flexible Framework of Deep Reinforcement Learning for Operation Research

2023-03-23 · Ching Pui Wan, Tung Li, Jason Min Wang

Reinforcement learning has been applied in operation research and has shown promise in solving large combinatorial optimization problems. However, existing works focus on developing neural network architectures for certain problems. These works lack the flexibility to incorporate recent advances in reinforcement learning, as well as the flexibility of customizing model architectures for operation research problems. In this work, we analyze the end-to-end autoregressive models for vehicle routing problems and show that these models can benefit from the recent advances in reinforcement learning with a careful re-implementation of the model architecture. In particular, we re-implemented the Attention Model and trained it with Proximal Policy Optimization (PPO) in CleanRL, showing at least 8 times speed up in training time. We hereby introduce RLOR, a flexible framework for Deep Reinforcement Learning for Operation Research. We believe that a flexible framework is key to developing deep reinforcement learning models for operation research problems. The code of our work is publicly available at https://github.com/cpwan/RLOR.

📄 PDF Abstract BibTeX arXiv:2303.13117

Code (1)

cpwan/rlor pytorch

Tasks

Combinatorial OptimizationDeep Reinforcement Learningreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modules

2024-03-18 · Xiangyu Chen, Jing Liu, Ye Wang, Pu 외

Low-rank adaptation (LoRA) and its variants are widely employed in fine-tuning large models, including large language models for natural language processing and diffusion models for computer vision. This paper proposes a…

Transfer Learning

EulerLoRA: Rank-Driven Jump Dynamics for Calibrated Parameter-Efficient Fine-Tuning

2026-08-02 · Srinivas Anumasa, Dianbo Liu arxiv

Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning, but standard LoRA produces a single deterministic model and does not directly support predictive uncertainty estimation. We introduce EulerLoRA, a stoch…

parameter-efficient fine-tuningOut-of-Distribution Detection

MiCull2 -- simulating mastitis transmission through milking order

2024-12-13 · Maya Gussmann, Carsten Kirkeby, Lars Rönnegård

Contagious mastitis pathogens can be transmitted through milking. However, previously published simulation models, such as MiCull, have not directly taken this into account. We have reimplemented the MiCull model to mode…

CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation

2024-10-12 · Yifeng Xu, Zhenliang He, Shiguang Shan, Xilin Chen

Recently, large-scale diffusion models have made impressive progress in text-to-image (T2I) generation. To further equip these T2I models with fine-grained spatial control, approaches like ControlNet introduce an extra n…

Conditional Image GenerationGPUImage Generation

SRLoRA: Subspace Recomposition in Low-Rank Adaptation via Importance-Based Fusion and Reinitialization

2025-05-18 · Haodong Yang, Lei Wang, Md Zakir Hossain

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method that injects two trainable low-rank matrices (A and B) into frozen pretrained models. While efficient, LoRA constrains updates …

image-classificationImage Classificationparameter-efficient fine-tuning