paper-with-me

Papers

Collision- and Reachability-Aware Multi-Robot Control with Grounded LLM Planners

2025-05-26 · Jiabao Ji, Yongchao Chen, Yang Zhang, Ramana Rao Kompella, Chuchu Fan, Gaowen Liu, Shiyu Chang

Large language models (LLMs) have demonstrated strong performance in various robot control tasks. However, their deployment in real-world applications remains constrained. Even state-ofthe-art LLMs, such as GPT-o4mini, frequently produce invalid action plans that violate physical constraints, such as directing a robot to an unreachable location or causing collisions between robots. This issue primarily arises from a lack of awareness of these physical constraints during the reasoning process. To address this issue, we propose a novel framework that integrates reinforcement learning with verifiable rewards (RLVR) to incentivize knowledge of physical constraints into LLMs to induce constraints-aware reasoning during plan generation. In this approach, only valid action plans that successfully complete a control task receive positive rewards. We applied our method to two small-scale LLMs: a non-reasoning Qwen2.5-3B-Instruct and a reasoning Qwen3-4B. The experiment results demonstrate that constraint-aware small LLMs largely outperform large-scale models without constraints, grounded on both the BoxNet task and a newly developed BoxNet3D environment built using MuJoCo. This work highlights the effectiveness of grounding even small LLMs with physical constraints to enable scalable and efficient multi-robot control in complex, physically constrained environments.

📄 PDF Abstract BibTeX arXiv:2505.20573

Code (0)

등록된 구현이 없습니다.

Tasks

MuJoCovalid

Similar Papers 제목 키워드 기반

KCFRC: Kinematic Collision-Aware Foothold Reachability Criteria for Legged Locomotion

2026-02-24 · Lei Ye, Haibo Gao, Huaiguang Yang, Peng Xu 외 arxiv

Legged robots face significant challenges in navigating complex environments, as they require precise real-time decisions for foothold selection and contact planning. While existing research has explored methods to selec…

Collision-Aware Target-Driven Object Grasping in Constrained Environments

2021-04-01 · Xibai Lou, Yang Yang, Changhyun Choi

Grasping a novel target object in constrained environments (e.g., walls, bins, and shelves) requires intensive reasoning about grasp pose reachability to avoid collisions with the surrounding structures. Typical 6-DoF ro…

ObjectRobotic Grasping

$λ$-Reachability: Geometric-Horizon Safety Bellman Equations for Humanoid Safety

2026-06-14 · Rui Chen, Shangtao Li, Yifan Sun, Changliu Liu arxiv

We introduce $λ$-Reachability, a scalable approach to Hamilton--Jacobi safety analysis for high-dimensional robotic systems. Unlike prior discounted formulations that rely on fixed one-step Bellman updates, $λ$-Reachabil…

Collision Avoidance

Grounding Generative Policies in Physics: Optimization-Guided Diffusion for Robot Control

2026-06-23 · Sabrina Bodmer, René Zurbrügg, Tifanny Portela, Hao Ma 외 arxiv

Diffusion models sample effectively from high-dimensional, multimodal distributions, but their outputs may violate deployment constraints. For task-space robot policies, generated grasps, waypoints, or trajectories can b…

Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis

2025-02-02 · Kensuke Nakamura, Lasse Peters, Andrea Bajcsy

Hamilton-Jacobi (HJ) reachability is a rigorous mathematical framework that enables robots to simultaneously detect unsafe states and generate actions that prevent future failures. While in theory, HJ reachability can sy…

Collision Avoidance