Activity Recognition on Avatar-Anonymized Datasets with Masked Differential Privacy
Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. Prevalent methods tackling this problem use differential privacy (DP) or obfuscation techniques to protect the privacy of individuals. In both cases, the utility of the trained model is sacrificed heavily in this process. In this work, we present an anonymization pipeline that replaces sensitive human subjects in video datasets with synthetic avatars within context, employing a combined rendering and stable diffusion-based strategy. Additionally we propose masked differential privacy ({MaskDP}) to protect non-anonymized but privacy sensitive background information. MaskDP allows for controlling sensitive regions where differential privacy is applied, in contrast to applying DP on the entire input. This combined methodology provides strong privacy protection while minimizing the usual performance penalty of privacy preserving methods. Experiments on multiple challenging action recognition datasets demonstrate that our proposed techniques result in better utility-privacy trade-offs compared to standard differentially private training in the especially demanding $\epsilon<1$ regime.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionActivity RecognitionPrivacy PreservingSimilar Papers 제목 키워드 기반
Privacy-Preserving Human Activity Recognition from Extreme Low Resolution
Privacy protection from surreptitious video recordings is an important societal challenge. We desire a computer vision system (e.g., a robot) that can recognize human activities and assist our daily life, yet ensure that…
Activity RecognitionHuman Activity RecognitionPrivacy PreservingSuper-ResolutionMaskFi: Unsupervised Learning of WiFi and Vision Representations for Multimodal Human Activity Recognition
Human activity recognition (HAR) has been playing an increasingly important role in various domains such as healthcare, security monitoring, and metaverse gaming. Though numerous HAR methods based on computer vision have…
Activity RecognitionHuman Activity RecognitionRepresentation LearningUnderstanding Person Identification through Gait
Gait recognition is the process of identifying humans from their bipedal locomotion such as walking or running. As such, gait data is privacy sensitive information and should be anonymized where possible. With the rise o…
Gait RecognitionPerson IdentificationAViD Dataset: Anonymized Videos from Diverse Countries
We introduce a new public video dataset for action recognition: Anonymized Videos from Diverse countries (AViD). Unlike existing public video datasets, AViD is a collection of action videos from many different countries.…
Action ClassificationAction DetectionAction RecognitionMasked Face Recognition Dataset and Application
In order to effectively prevent the spread of COVID-19 virus, almost everyone wears a mask during coronavirus epidemic. This almost makes conventional facial recognition technology ineffective in many cases, such as comm…
Face DetectionFace Recognition