paper-with-me

Papers

DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control

2026-04-28 · Chenbo Yu arxiv

Traffic signal control (TSC) plays a central role in reducing congestion and maintaining urban mobility. This dissertation introduces DGLight, a critic-guided reinforcement-learning framework for adapting a pretrained large language model to TSC. DGLight first trains a CoLight-based Deep Q-Network critic to estimate traffic-aware action values from structured intersection states, then uses the frozen critic to score candidate language-model actions and optimize the policy with Group Relative Policy Optimization (GRPO). The resulting controller maps traffic states to interpretable reasoning traces and signal decisions while learning from dense per-state supervision rather than raw cumulative environment rewards. Experiments on TSC benchmarks covering Jinan and Hangzhou show that DGLight is the strongest overall method among the compared LLM-based controllers, remains competitive with strong RL baselines, and transfers well to city datasets not used to fit the critic. Qualitative examples further show that the model's generated reasoning is interpretable and aligned with the chosen signal phase. The project code is available $\href{https://github.com/yyccbb/FYP_LLMTSC}{here}$.

📄 PDF Abstract BibTeX arXiv:2604.25259

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Entropy-guided sequence weighting for efficient exploration in RL-based LLM fine-tuning

2025-03-28 · Abdullah Vanlioglu

We introduce Entropy-Guided Sequence Weighting (EGSW), a novel approach that enhances the exploration-exploitation tradeoff by dynamically assigning weights to generated outputs based on their advantage and entropy for R…

Efficient ExplorationLanguage ModelingLanguage ModellingLarge Language Model+3

GRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

2026-01-10 · Besher Hassan, Xiuying Chen arxiv

Parameter efficient fine tuning is a way to adapt LLMs to new languages when compute or data are limited, yet adapter pipelines usually choose a global prune ratio by grid search. This practice is computationally expensi…

Question Answering

Can GRPO Boost Complex Multimodal Table Understanding?

2025-09-21 · Xiaoqiang Kang, Shengen Wu, Zimu Wang, Yilin Liu 외 arxiv

Existing table understanding methods face challenges due to complex table structures and intricate logical reasoning. While supervised finetuning (SFT) dominates existing research, reinforcement learning (RL), such as Gr…

Reinforcement LearningLogical Reasoning

Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPO

2026-06-01 · Tianyang Chen, Wenjun Li, Xin zhou, Yuze Wu 외 arxiv

Vision-Language-Action (VLA) models offer a promising end-to-end paradigm for unmanned aerial vehicles (UAVs) to accomplish complex tasks specified by fine-grained instructions. However, standard supervised fine-tuning (…

Reinforcement Learning

MedGRPO: Multi-Task Reinforcement Learning for Heterogeneous Medical Video Understanding

2025-12-06 · Yuhao Su, Anwesa Choudhuri, Zhongpai Gao, Benjamin Planche 외 arxiv

Large vision-language models struggle with medical video understanding, where spatial precision, temporal reasoning, and clinical semantics are critical. To address this, we first introduce \textbf{MedVidBench}, a large-…

Reinforcement Learning