paper-with-me

홈 › Papers

Personalized Federated Deep Learning for Pain Estimation From Face Images

2021-01-12 · Ognjen Rudovic, Nicolas Tobis, Sebastian Kaltwang, Björn Schuller, Daniel Rueckert, Jeffrey F. Cohn, Rosalind W. Picard

Standard machine learning approaches require centralizing the users' data in one computer or a shared database, which raises data privacy and confidentiality concerns. Therefore, limiting central access is important, especially in healthcare settings, where data regulations are strict. A potential approach to tackling this is Federated Learning (FL), which enables multiple parties to collaboratively learn a shared prediction model by using parameters of locally trained models while keeping raw training data locally. In the context of AI-assisted pain-monitoring, we wish to enable confidentiality-preserving and unobtrusive pain estimation for long-term pain-monitoring and reduce the burden on the nursing staff who perform frequent routine check-ups. To this end, we propose a novel Personalized Federated Deep Learning (PFDL) approach for pain estimation from face images. PFDL performs collaborative training of a deep model, implemented using a lightweight CNN architecture, across different clients (i.e., subjects) without sharing their face images. Instead of sharing all parameters of the model, as in standard FL, PFDL retains the last layer locally (used to personalize the pain estimates). This (i) adds another layer of data confidentiality, making it difficult for an adversary to infer pain levels of the target subject, while (ii) personalizing the pain estimation to each subject through local parameter tuning. We show using a publicly available dataset of face videos of pain (UNBC-McMaster Shoulder Pain Database), that PFDL performs comparably or better than the standard centralized and FL algorithms, while further enhancing data privacy. This, has the potential to improve traditional pain monitoring by making it more secure, computationally efficient, and scalable to a large number of individuals (e.g., for in-home pain monitoring), providing timely and unobtrusive pain measurement.

📄 PDF Abstract BibTeX arXiv:2101.04800

Code (1)

ntobis/federated-machine-learning 공식 구현 tf

Tasks

Deep LearningFederated Learning

Similar Papers 제목 키워드 기반

Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions

2017-06-22 · Daniel Lopez Martinez, Ognjen Rudovic, Rosalind Picard

Pain is a personal, subjective experience that is commonly evaluated through visual analog scales (VAS). While this is often convenient and useful, automatic pain detection systems can reduce pain score acquisition effor…

DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain

2017-08-09 · Dianbo Liu, Fengjiao Peng, Andrew Shea, Ognjen 외

Previous research on automatic pain estimation from facial expressions has focused primarily on "one-size-fits-all" metrics (such as PSPI). In this work, we focus on directly estimating each individual's self-reported vi…

Multi-Task Learning

Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning

2017-11-10 · Daniel Lopez-Martinez, Ognjen Rudovic, Rosalind Picard

Pain is a subjective experience commonly measured through patient's self report. While there exist numerous situations in which automatic pain estimation methods may be preferred, inter-subject variability in physiologic…

BIG-bench Machine Learning

PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting

2023-04-12 · ICCV 2023 1 · Saman Motamed, Jianjin Xu, Chen Henry Wu, Fernando de la Torre

Generative models such as StyleGAN2 and Stable Diffusion have achieved state-of-the-art performance in computer vision tasks such as image synthesis, inpainting, and de-noising. However, current generative models for fac…

Facial InpaintingImage Generation

FedFR: Joint Optimization Federated Framework for Generic and Personalized Face Recognition

2021-12-23 · Chih-Ting Liu, Chien-Yi Wang, Shao-Yi Chien, Shang-Hong Lai

Current state-of-the-art deep learning based face recognition (FR) models require a large number of face identities for central training. However, due to the growing privacy awareness, it is prohibited to access the face…

Face RecognitionFederated Learning