Membership Inference Attacks on In-Context Examples in LLM-based Recommender Systems
Large language models (LLMs) based recommender systems (RecSys) can adapt flexibly across different domains. It uses in-context learning (ICL), i.e., prompts, including sensitive historical user-specific item interactions, to customize the recommendation functions. However, no study has examined whether such private information may be exposed by novel privacy attacks. We design two membership inference attacks (MIAs): \emph{ItemMem}, and \emph{RecInertia}, aiming to identify whether system prompts contain the victim's information. We have carefully evaluated them on the latest open-source LLMs and three well-known RecSys datasets. The results confirm that the MIA threat to LLM RecSys is realistic and can be more sophisticated than prompt extraction. They utilize the unique prompt structures in ICL RecSys and cannot be easily mitigated with existing defense methods on prompt extraction.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Debiasing Learning for Membership Inference Attacks Against Recommender Systems
Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inferenc…
Recommendation SystemsMembership Inference Attacks for Retrieval Based In-Context Learning for Document Question Answering
We show that remotely hosted applications employing in-context learning when augmented with a retrieval function to select in-context examples can be vulnerable to membership-inference attacks even when the service provi…
Question AnsweringMembership Inference Attacks Against Recommender Systems
Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential dat…
Recommendation SystemsPrivacy Vulnerabilities of Attention Layers in Tabular Foundation Models and Protection of High-Risk Queries
Tabular foundation models are commonly assumed to present limited privacy concerns as they are often pre-trained on large collections of synthetic data. However, these models leverage in-context learning, where sensitive…
Interaction-level Membership Inference Attack Against Federated Recommender Systems
The marriage of federated learning and recommender system (FedRec) has been widely used to address the growing data privacy concerns in personalized recommendation services. In FedRecs, users' attribute information and b…
AttributeFederated LearningInference AttackMembership Inference Attack+1