SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation

2024-03-01 · Noriaki Hirose, Dhruv Shah, Kyle Stachowicz, Ajay Sridhar, Sergey Levine

Autonomous self-improving robots that interact and improve with experience are key to the real-world deployment of robotic systems. In this paper, we propose an online learning method, SELFI, that leverages online robot experience to rapidly fine-tune pre-trained control policies efficiently. SELFI applies online model-free reinforcement learning on top of offline model-based learning to bring out the best parts of both learning paradigms. Specifically, SELFI stabilizes the online learning process by incorporating the same model-based learning objective from offline pre-training into the Q-values learned with online model-free reinforcement learning. We evaluate SELFI in multiple real-world environments and report improvements in terms of collision avoidance, as well as more socially compliant behavior, measured by a human user study. SELFI enables us to quickly learn useful robotic behaviors with less human interventions such as pre-emptive behavior for the pedestrians, collision avoidance for small and transparent objects, and avoiding travel on uneven floor surfaces. We provide supplementary videos to demonstrate the performance of our fine-tuned policy on our project page.

📄 PDF Abstract BibTeX arXiv:2403.00991

Code (0)

등록된 구현이 없습니다.

Tasks

Collision Avoidance reinforcement-learning Reinforcement LearningSocial NavigationTransparent objects

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Inducing Cooperative behaviour in Sequential-Social dilemmas through Multi-Agent Reinforcement Learning using Status-Quo Loss

2020-01-15 · Pinkesh Badjatiya, Mausoom Sarkar, Abhishek Sinha, Siddharth Singh 외

In social dilemma situations, individual rationality leads to sub-optimal group outcomes. Several human engagements can be modeled as a sequential (multi-step) social dilemmas. However, in contrast to humans, Deep Reinfo…

Clustering Deep Reinforcement Learning Multi-agent Reinforcement Learning Reinforcement Learning

Selfie Drone Stick: A Natural Interface for Quadcopter Photography

2019-09-14 · Saif Alabachi, Gita Sukthankar, Rahul Sukthankar

A physical selfie stick extends the user's reach, enabling the acquisition of personal photos that include more of the background scene. Similarly, a quadcopter can capture photos from vantage points unattainable by the …

Deep Reinforcement Learning

The self-organization of selfishness: Reinforcement Learning shows how selfish behavior can emerge from agent-environment interaction dynamics

2023-02-28 · Aamir Sahil Chandroth, Nithya Ramakrishnan, Sanjay Chandrasekharan

When biological communities use signaling structures for complex coordination, 'free-riders' emerge. The free-riding agents do not contribute to the community resources (signals), but exploit them. Most models of such 's…

Prosocial or Selfish? Agents with different behaviors for Contract Negotiation using Reinforcement Learning

2018-09-19 · Vishal Sunder, Lovekesh Vig, Arnab Chatterjee, Gautam Shroff

We present an effective technique for training deep learning agents capable of negotiating on a set of clauses in a contract agreement using a simple communication protocol. We use Multi Agent Reinforcement Learning to t…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Incentivising cooperation by rewarding the weakest member

2022-10-04 · Jory Schossau, Bamshad Shirmohammadi, Arend Hintze

Autonomous agents that act with each other on behalf of humans are becoming more common in many social domains, such as customer service, transportation, and health care. In such social situations greedy strategies can r…

Decision Making