paper-with-me

Papers

Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy

2026-05-16 · Youngmok Ha, Viktor Schlegel, Yidan Sun, Anil Anthony Bharath arxiv

While Local Differential Privacy (LDP) serves as a foundational primitive for distributed data collection, its stringent randomization requirements often lead to severe degradation in data utility. This degradation stems from the task-agnostic nature of conventional LDP mechanisms, which perturb all dimensions without accounting for their relative importance to the downstream objective. To address this issue, we propose a novel approach that mitigates noise in task-relevant subspaces of the data representation. Our method identifies task-critical subspaces via the Jacobian of a public downstream model, selectively attenuates noise along these directions, and reshapes the isotropic noise of standard LDP mechanisms into an anisotropic distribution. The resulting mechanism preserves the privacy guarantee of the underlying LDP randomizer while heterogeneously modulating the impact of noise across task directions, thereby substantially enhancing data utility. The approach is applicable to both linear and nonlinear models and can be seamlessly integrated with existing LDP mechanisms. Extensive experiments on CIFAR-10-C under brightness corruption at the highest severity level demonstrate that integrating our approach improves classification accuracy by approximately 8 percentage points for Laplace and 20 percentage points for PrivUnit variants at $ε=7.5$. The source code is available at https://github.com/ymha/jacobian-anr-ldp.

📄 PDF Abstract BibTeX arXiv:2605.16812

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Jacobian-guided Noise Injection for Quantization Robustness in Large Language Models

2026-08-21 · Deepanshu Pandey, Arnav Chavan, Nahush Lele, Sankalp Dayal 외 arxiv

Quantization of Large Language Models (LLMs) is often hindered by the sensitivity of the self-attention mechanism to discretization errors. We identify the softmax operator as a bottleneck for quantization stability due …

Shortcut Invariance: Targeted Jacobian Regularization in Disentangled Latent Space

2025-11-24 · Shivam Pal, Sakshi Varshney, Piyush Rai arxiv

Deep neural networks are prone to learning shortcuts, spurious correlations present in the training data that undermine out-of-distribution (OOD) generalization. Most prior work mitigates shortcut learning through input-…

Analysis of the Entropy-guided Switching Trimmed Mean Deviation-based Anisotropic Diffusion filter

2016-04-21 · Uche A. Nnolim

This report describes the experimental analysis of a proposed switching filter-anisotropic diffusion hybrid for the filtering of the fixed value (salt and pepper) impulse noise (FVIN). The filter works well at both low a…

Weighted structure tensor total variation for image denoising

2023-06-18 · Xiuhan Sheng, Lijuan Yang, Jingya Chang

For image denoising problems, the structure tensor total variation (STV)-based models show good performances when compared with other competing regularization approaches. However, the STV regularizer does not couple the …

DenoisingImage Denoising

Guided Depth Super-Resolution by Deep Anisotropic Diffusion

2022-11-21 · CVPR 2023 1 · Nando Metzger, Rodrigo Caye Daudt, Konrad Schindler

Performing super-resolution of a depth image using the guidance from an RGB image is a problem that concerns several fields, such as robotics, medical imaging, and remote sensing. While deep learning methods have achieve…

Super-Resolution