Privacy in Multimodal Federated Human Activity Recognition
Human Activity Recognition (HAR) training data is often privacy-sensitive or held by non-cooperative entities. Federated Learning (FL) addresses such concerns by training ML models on edge clients. This work studies the impact of privacy in federated HAR at a user, environment, and sensor level. We show that the performance of FL for HAR depends on the assumed privacy level of the FL system and primarily upon the colocation of data from different sensors. By avoiding data sharing and assuming privacy at the human or environment level, as prior works have done, the accuracy decreases by 5-7%. However, extending this to the modality level and strictly separating sensor data between multiple clients may decrease the accuracy by 19-42%. As this form of privacy is necessary for the ethical utilisation of passive sensing methods in HAR, we implement a system where clients mutually train both a general FL model and a group-level one per modality. Our evaluation shows that this method leads to only a 7-13% decrease in accuracy, making it possible to build HAR systems with diverse hardware.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionFederated LearningHuman Activity RecognitionSimilar Papers 제목 키워드 기반
GraMFedDHAR: Graph Based Multimodal Differentially Private Federated HAR
Human Activity Recognition (HAR) using multimodal sensor data remains challenging due to noisy or incomplete measurements, scarcity of labeled examples, and privacy concerns. Traditional centralized deep learning approac…
Human Activity RecognitionFederated LearningFederated Split Learning for Human Activity Recognition with Differential Privacy
This paper proposes a novel intelligent human activity recognition (HAR) framework based on a new design of Federated Split Learning (FSL) with Differential Privacy (DP) over edge networks. Our FSL-DP framework leverages…
Activity RecognitionFederated LearningHuman Activity RecognitionLabel Leakage in Federated Inertial-based Human Activity Recognition
While prior work has shown that Federated Learning updates can leak sensitive information, label reconstruction attacks, which aim to recover input labels from shared gradients, have not yet been examined in the context …
Activity RecognitionFederated LearningHuman Activity RecognitionSemi-supervised Federated Learning for Activity Recognition
Training deep learning models on in-home IoT sensory data is commonly used to recognise human activities. Recently, federated learning systems that use edge devices as clients to support local human activity recognition …
Activity RecognitionData AugmentationFederated LearningHuman Activity RecognitionMHARFedLLM: Multimodal Human Activity Recognition Using Federated Large Language Model
Human Activity Recognition (HAR) plays a vital role in applications such as fitness tracking, smart homes, and healthcare monitoring. Traditional HAR systems often rely on single modalities, such as motion sensors or cam…
Human Activity RecognitionFederated Learning