paper-with-me

Papers

Intermediate Outputs Are More Sensitive Than You Think

2024-12-01 · Tao Huang, Qingyu Huang, Jiayang Meng

The increasing reliance on deep computer vision models that process sensitive data has raised significant privacy concerns, particularly regarding the exposure of intermediate results in hidden layers. While traditional privacy risk assessment techniques focus on protecting overall model outputs, they often overlook vulnerabilities within these intermediate representations. Current privacy risk assessment techniques typically rely on specific attack simulations to assess risk, which can be computationally expensive and incomplete. This paper introduces a novel approach to measuring privacy risks in deep computer vision models based on the Degrees of Freedom (DoF) and sensitivity of intermediate outputs, without requiring adversarial attack simulations. We propose a framework that leverages DoF to evaluate the amount of information retained in each layer and combines this with the rank of the Jacobian matrix to assess sensitivity to input variations. This dual analysis enables systematic measurement of privacy risks at various model layers. Our experimental validation on real-world datasets demonstrates the effectiveness of this approach in providing deeper insights into privacy risks associated with intermediate representations.

📄 PDF Abstract BibTeX arXiv:2412.00696

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackSensitivity

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens

2025-10-13 · Armel Zebaze, Rachel Bawden, Benoît Sagot arxiv

Large reasoning models (LRMs) have led to new possibilities in terms of problem-solving, through the devising of a natural language thought process prior to answering a query. While their capabilities are well known acro…

Synthetic Data GenerationMachine Translation

Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers

2025-06-18 · Tommaso Green, Martin Gubri, Haritz Puerto, Sangdoo Yun 외

We study privacy leakage in the reasoning traces of large reasoning models used as personal agents. Unlike final outputs, reasoning traces are often assumed to be internal and safe. We challenge this assumption by showin…

Teaching Language Models to Think in Code

2026-05-08 · Hyeon Hwang, Jiwoo Lee, Jaewoo Kang arxiv

Tool-integrated reasoning (TIR) has emerged as a dominant paradigm for mathematical problem solving in language models, combining natural language (NL) reasoning with code execution. However, this interleaved setup has t…

Reinforcement Learning

GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving

2026-05-25 · Yingji Zhang, Yong Dai, André Freitas arxiv

Mathematical reasoning is a hallmark of human intelligence, requiring logical deduction, symbolic manipulation, and abstract thinking. Recent multimodal large language models (MLLMs) have demonstrated strong performance …

Mathematical ReasoningCode Generation

Avoid Overthinking in Self-Supervised Models for Speech Recognition

2022-11-01 · Dan Berrebbi, Brian Yan, Shinji Watanabe

Self-supervised learning (SSL) models reshaped our approach to speech, language and vision. However their huge size and the opaque relations between their layers and tasks result in slow inference and network overthinkin…

Self-Supervised LearningSequence-To-Sequence Speech Recognitionspeech-recognitionSpeech Recognition