paper-with-me

홈 › Papers

Crafter: Facial Feature Crafting against Inversion-based Identity Theft on Deep Models

2024-01-14 · Shiming Wang, Zhe Ji, Liyao Xiang, Hao Zhang, Xinbing Wang, Chenghu Zhou, Bo Li

With the increased capabilities at the edge (e.g., mobile device) and more stringent privacy requirement, it becomes a recent trend for deep learning-enabled applications to pre-process sensitive raw data at the edge and transmit the features to the backend cloud for further processing. A typical application is to run machine learning (ML) services on facial images collected from different individuals. To prevent identity theft, conventional methods commonly rely on an adversarial game-based approach to shed the identity information from the feature. However, such methods can not defend against adaptive attacks, in which an attacker takes a countermove against a known defence strategy. We propose Crafter, a feature crafting mechanism deployed at the edge, to protect the identity information from adaptive model inversion attacks while ensuring the ML tasks are properly carried out in the cloud. The key defence strategy is to mislead the attacker to a non-private prior from which the attacker gains little about the private identity. In this case, the crafted features act like poison training samples for attackers with adaptive model updates. Experimental results indicate that Crafter successfully defends both basic and possible adaptive attacks, which can not be achieved by state-of-the-art adversarial game-based methods.

📄 PDF Abstract BibTeX arXiv:2401.07205

Code (1)

shimingwang98/facial_feature_crafting_against_inversion_based_identity_theft 공식 구현 pytorch

Similar Papers 제목 키워드 기반

PromptCrafter: Crafting Text-to-Image Prompt through Mixed-Initiative Dialogue with LLM

2023-07-18 · Seungho Baek, Hyerin Im, Jiseung Ryu, Juhyeong Park 외

Text-to-image generation model is able to generate images across a diverse range of subjects and styles based on a single prompt. Recent works have proposed a variety of interaction methods that help users understand the…

Image GenerationLanguage ModelingLanguage ModellingLarge Language Model+2

More comprehensive facial inversion for more effective expression recognition

2022-11-24 · Jiawei Mao, Guangyi Zhao, Yuanqi Chang, Xuesong Yin 외

Facial expression recognition (FER) plays a significant role in the ubiquitous application of computer vision. We revisit this problem with a new perspective on whether it can acquire useful representations that improve …

Facial Expression RecognitionFacial Expression Recognition (FER)Image Generation

Benchmarking the Spectrum of Agent Capabilities

2021-09-14 · ICLR 2022 4 · Danijar Hafner

Evaluating the general abilities of intelligent agents requires complex simulation environments. Existing benchmarks typically evaluate only one narrow task per environment, requiring researchers to perform expensive tra…

Benchmarking

EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model

2026-04-11 · Kunho Kim, Sumin Seo, Yongjun Cho, Hyungjin Chung arxiv

We propose EditCrafter, a high-resolution image editing method that operates without tuning, leveraging pretrained text-to-image (T2I) diffusion models to process images at resolutions significantly exceeding those used …

Image Editing

PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control

2024-05-23 · Yong Zhong, Min Zhao, Zebin You, Xiaofeng Yu 외

In this paper, we introduce PoseCrafter, a one-shot method for personalized video generation following the control of flexible poses. Built upon Stable Diffusion and ControlNet, we carefully design an inference process t…

Video Generation