paper-with-me

Papers

LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control

2024-01-10 · Saurav Agarwal, Ramya Muthukrishnan, Walker Gosrich, Vijay Kumar, Alejandro Ribeiro

Coverage control is the problem of navigating a robot swarm to collaboratively monitor features or a phenomenon of interest not known a priori. The problem is challenging in decentralized settings with robots that have limited communication and sensing capabilities. We propose a learnable Perception-Action-Communication (LPAC) architecture for the problem, wherein a convolution neural network (CNN) processes localized perception; a graph neural network (GNN) facilitates robot communications; finally, a shallow multi-layer perceptron (MLP) computes robot actions. The GNN enables collaboration in the robot swarm by computing what information to communicate with nearby robots and how to incorporate received information. Evaluations show that the LPAC models -- trained using imitation learning -- outperform standard decentralized and centralized coverage control algorithms. The learned policy generalizes to environments different from the training dataset, transfers to larger environments with more robots, and is robust to noisy position estimates. The results indicate the suitability of LPAC architectures for decentralized navigation in robot swarms to achieve collaborative behavior.

📄 PDF Abstract BibTeX arXiv:2401.04855

Code (1)

kumarrobotics/coveragecontrol 공식 구현 pytorch

Tasks

Graph Neural NetworkImitation Learning

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Constrained Learning for Decentralized Multi-Objective Coverage Control

2024-09-17 · Juan Cervino, Saurav Agarwal, Vijay Kumar, Alejandro Ribeiro

The multi-objective coverage control problem requires a robot swarm to collaboratively provide sensor coverage to multiple heterogeneous importance density fields IDFs simultaneously. We pose this as an optimization prob…

Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networks

2021-06-24 · Ting-Kuei Hu, Fernando Gama, Tianlong Chen, Wenqing Zheng 외

In this paper, we present a perception-action-communication loop design using Vision-based Graph Aggregation and Inference (VGAI). This multi-agent decentralized learning-to-control framework maps raw visual observations…

Graph Neural NetworkImitation Learning

Who2com: Collaborative Perception via Learnable Handshake Communication

2020-03-21 · Yen-Cheng Liu, Junjiao Tian, Chih-Yao Ma, Nathan Glaser 외

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike ex…

Multi-agent Reinforcement LearningReinforcement LearningScene UnderstandingSemantic Segmentation

One to rule them all: natural language to bind communication, perception and action

2024-11-22 · Simone Colombani, Dimitri Ognibene, Giuseppe Boccignone

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These system…

All

SmartCooper: Vehicular Collaborative Perception with Adaptive Fusion and Judger Mechanism

2024-02-01 · Yuang Zhang, Haonan An, Zhengru Fang, Guowen Xu 외

In recent years, autonomous driving has garnered significant attention due to its potential for improving road safety through collaborative perception among connected and autonomous vehicles (CAVs). However, time-varying…

Autonomous DrivingAutonomous Vehicles