paper-with-me

홈 › Papers

The Mythos of Model Interpretability

2016-06-10 · Zachary C. Lipton

Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet the task of interpretation appears underspecified. Papers provide diverse and sometimes non-overlapping motivations for interpretability, and offer myriad notions of what attributes render models interpretable. Despite this ambiguity, many papers proclaim interpretability axiomatically, absent further explanation. In this paper, we seek to refine the discourse on interpretability. First, we examine the motivations underlying interest in interpretability, finding them to be diverse and occasionally discordant. Then, we address model properties and techniques thought to confer interpretability, identifying transparency to humans and post-hoc explanations as competing notions. Throughout, we discuss the feasibility and desirability of different notions, and question the oft-made assertions that linear models are interpretable and that deep neural networks are not.

📄 PDF Abstract BibTeX arXiv:1606.03490

Code (2)

cmougan/WRI_WellBeing_Data_Layer
dssg/solveforgood-wri

Tasks

model

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

TreeView: Peeking into Deep Neural Networks Via Feature-Space Partitioning

2016-11-22 · Jayaraman J. Thiagarajan, Bhavya Kailkhura, Prasanna Sattigeri, Karthikeyan Natesan Ramamurthy

With the advent of highly predictive but opaque deep learning models, it has become more important than ever to understand and explain the predictions of such models. Existing approaches define interpretability as the in…

Benchmarking Mythos-Linked Bug Rediscovery

2026-05-17 · Isaac David, Arthur Gervais arxiv

Anthropic's April 2026 Mythos materials combine benchmark claims with concrete bug-finding stories across OpenBSD, FreeBSD, Linux, FFmpeg, and browsers. This paper reports a controlled target-file rediscovery experiment …

Mythos and the Unverified Cage: Z3-Based Pre-Deployment Verification for Frontier-Model Sandbox Infrastructure

2026-04-22 · Dominik Blain arxiv

The April 2026 Claude Mythos sandbox escape exposed a critical weakness in frontier AI containment: the infrastructure surrounding advanced models remains susceptible to formally characterizable arithmetic vulnerabilitie…

Evaluating whether AI models would sabotage AI safety research

2026-04-27 · Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D'Cruz 외 arxiv

We evaluate the propensity of frontier models to sabotage or refuse to assist with safety research when deployed as AI research agents within a frontier AI company. We apply two complementary evaluations to four Claude m…

Functional Emotions or Situational Contexts? A Discriminating Test from the Mythos Preview System Card

2026-04-09 · Hiranya V. Peiris arxiv

The Claude Mythos Preview system card deploys emotion vectors, sparse autoencoder (SAE) features, and activation verbalisers to study model internals during misaligned behaviour. The two primary toolkits are not jointly …