paper-with-me

Papers

Rendering-Refined Stable Diffusion for Privacy Compliant Synthetic Data

2024-12-09 · Kartik Patwari, David Schneider, Xiaoxiao Sun, Chen-Nee Chuah, Lingjuan Lyu, Vivek Sharma

Growing privacy concerns and regulations like GDPR and CCPA necessitate pseudonymization techniques that protect identity in image datasets. However, retaining utility is also essential. Traditional methods like masking and blurring degrade quality and obscure critical context, especially in human-centric images. We introduce Rendering-Refined Stable Diffusion (RefSD), a pipeline that combines 3D-rendering with Stable Diffusion, enabling prompt-based control over human attributes while preserving posture. Unlike standard diffusion models that fail to retain posture or GANs that lack realism and flexible attribute control, RefSD balances posture preservation, realism, and customization. We also propose HumanGenAI, a framework for human perception and utility evaluation. Human perception assessments reveal attribute-specific strengths and weaknesses of RefSD. Our utility experiments show that models trained on RefSD pseudonymized data outperform those trained on real data in detection tasks, with further performance gains when combining RefSD with real data. For classification tasks, we consistently observe performance improvements when using RefSD data with real data, confirming the utility of our pseudonymized data.

📄 PDF Abstract BibTeX arXiv:2412.06248

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

S^3-Face: SSS-Compliant Facial Reflectance Estimation via Diffusion Priors

2025-01-01 · CVPR 2025 1 · Xingyu Ren, Jiankang Deng, Yuhao Cheng, Wenhan Zhu 외

Recent 3D face reconstruction methods have made remarkable advancements, yet achieving high-quality facial reflectance from monocular input remains challenging. Existing methods rely on the light-stage captured data …

3D Face ReconstructionFace Reconstruction

Learning Diffusion Policies from Demonstrations For Compliant Contact-rich Manipulation

2024-10-25 · Malek Aburub, Cristian C. Beltran-Hernandez, Tatsuya Kamijo, Masashi Hamaya

Robots hold great promise for performing repetitive or hazardous tasks, but achieving human-like dexterity, especially in contact-rich and dynamic environments, remains challenging. Rigid robots, which rely on position o…

Contact-rich Manipulation

ForgetMe: Evaluating Selective Forgetting in Generative Models

2025-04-17 · Zhenyu Yu, Mohd Yamani Inda Idris, Pei Wang

The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion mode…

Image GenerationPrivacy Preserving

Privacy Threats in Stable Diffusion Models

2023-11-15 · Thomas Cilloni, Charles Fleming, Charles Walter

This paper introduces a novel approach to membership inference attacks (MIA) targeting stable diffusion computer vision models, specifically focusing on the highly sophisticated Stable Diffusion V2 by StabilityAI. MIAs a…

Image Generation

Activity Recognition on Avatar-Anonymized Datasets with Masked Differential Privacy

2024-10-22 · David Schneider, Sina Sajadmanesh, Vikash Sehwag, Saquib Sarfraz 외

Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. Prevalent methods tackling this problem use differential privacy (DP) or obfuscation techniques to prot…

Action RecognitionActivity RecognitionPrivacy Preserving