paper-with-me

Papers

Data Leakage via Access Patterns of Sparse Features in Deep Learning-based Recommendation Systems

2022-12-12 · Hanieh Hashemi, Wenjie Xiong, Liu Ke, Kiwan Maeng, Murali Annavaram, G. Edward Suh, Hsien-Hsin S. Lee

Online personalized recommendation services are generally hosted in the cloud where users query the cloud-based model to receive recommended input such as merchandise of interest or news feed. State-of-the-art recommendation models rely on sparse and dense features to represent users' profile information and the items they interact with. Although sparse features account for 99% of the total model size, there was not enough attention paid to the potential information leakage through sparse features. These sparse features are employed to track users' behavior, e.g., their click history, object interactions, etc., potentially carrying each user's private information. Sparse features are represented as learned embedding vectors that are stored in large tables, and personalized recommendation is performed by using a specific user's sparse feature to index through the tables. Even with recently-proposed methods that hides the computation happening in the cloud, an attacker in the cloud may be able to still track the access patterns to the embedding tables. This paper explores the private information that may be learned by tracking a recommendation model's sparse feature access patterns. We first characterize the types of attacks that can be carried out on sparse features in recommendation models in an untrusted cloud, followed by a demonstration of how each of these attacks leads to extracting users' private information or tracking users by their behavior over time.

📄 PDF Abstract BibTeX arXiv:2212.06264

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Similar Papers 제목 키워드 기반

SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models

2026-06-29 · Shuaimin Li, Liyang Fan, Zeyang Li, Zhuoyue Wan 외 arxiv

Evaluating code large language models (Code LLMs) requires reliable detection of data leakage, where benchmark performance is artificially inflated by exposure to benchmark data during pre-training. Existing approaches e…

Privacy Leakage of SIFT Features via Deep Generative Model based Image Reconstruction

2020-09-02 · Haiwei Wu, Jiantao Zhou

Many practical applications, e.g., content based image retrieval and object recognition, heavily rely on the local features extracted from the query image. As these local features are usually exposed to untrustworthy par…

Content-Based Image RetrievalImage ReconstructionImage RetrievalObject Recognition+1

OLIVE: Oblivious Federated Learning on Trusted Execution Environment against the risk of sparsification

2022-02-15 · Fumiyuki Kato, Yang Cao, Masatoshi Yoshikawa

Combining Federated Learning (FL) with a Trusted Execution Environment (TEE) is a promising approach for realizing privacy-preserving FL, which has garnered significant academic attention in recent years. Implementing th…

Federated LearningInference AttackPrivacy Preserving

PrivacyScalpel: Enhancing LLM Privacy via Interpretable Feature Intervention with Sparse Autoencoders

2025-03-14 · Ahmed Frikha, Muhammad Reza Ar Razi, Krishna Kanth Nakka, Ricardo Mendes 외

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing …

MemorizationPrivacy Preserving

PRISM: Generation-Time Detection and Mitigation of Secret Leakage in Multi-Agent LLM Pipelines

2026-05-11 · Riya Tapwal, Abhishek Kumar, Carsten Maple arxiv

Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear in downstream outputs, even without explicit adversarial intent. We…