Federated Continual Learning for Socially Aware Robotics
From learning assistance to companionship, social robots promise to enhance many aspects of daily life. However, social robots have not seen widespread adoption, in part because (1) they do not adapt their behavior to new users, and (2) they do not provide sufficient privacy protections. Centralized learning, whereby robots develop skills by gathering data on a server, contributes to these limitations by preventing online learning of new experiences and requiring storage of privacy-sensitive data. In this work, we propose a decentralized learning alternative that improves the privacy and personalization of social robots. We combine two machine learning approaches, Federated Learning and Continual Learning, to capture interaction dynamics distributed physically across robots and temporally across repeated robot encounters. We define a set of criteria that should be balanced in decentralized robot learning scenarios. We also develop a new algorithm -- Elastic Transfer -- that leverages importance-based regularization to preserve relevant parameters across robots and interactions with multiple humans. We show that decentralized learning is a viable alternative to centralized learning in a proof-of-concept Socially-Aware Navigation domain, and demonstrate how Elastic Transfer improves several of the proposed criteria.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningFederated LearningSimilar Papers 제목 키워드 기반
Federated Learning of Socially Appropriate Agent Behaviours in Simulated Home Environments
As social robots become increasingly integrated into daily life, ensuring their behaviours align with social norms is crucial. For their widespread open-world application, it is important to explore Federated Learning (F…
Continual LearningFederated LearningTransformable Gaussian Reward Function for Socially-Aware Navigation with Deep Reinforcement Learning
Robot navigation has transitioned from prioritizing obstacle avoidance to adopting socially aware navigation strategies that accommodate human presence. As a result, the recognition of socially aware navigation within dy…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningRobot NavigationFeature Aggregation with Latent Generative Replay for Federated Continual Learning of Socially Appropriate Robot Behaviours
It is critical for robots to explore Federated Learning (FL) settings where several robots, deployed in parallel, can learn independently while also sharing their learning with each other. This collaborative learning in …
Continual LearningCPUFederated LearningGPUPrice of Stability in Quality-Aware Federated Learning
Federated Learning (FL) is a distributed machine learning scheme that enables clients to train a shared global model without exchanging local data. The presence of label noise can severely degrade the FL performance, and…
DenoisingFederated LearningConcept drift detection and adaptation for federated and continual learning
Smart devices, such as smartphones, wearables, robots, and others, can collect vast amounts of data from their environment. This data is suitable for training machine learning models, which can significantly improve thei…
Continual LearningDrift DetectionFederated Learning