The Case for Temporal Transparency: Detecting Policy Change Events in Black-Box Decision Making Systems
Bringing transparency to black-box decision making systems (DMS) has been a topic of increasing research interest in recent years. Traditional active and passive approaches to make these systems transparent are often limited by scalability and/or feasibility issues. In this paper, we propose a new notion of black-box DMS transparency, named, temporal transparency, whose goal is to detect if/when the DMS policy changes over time, and is mostly invariant to the drawbacks of traditional approaches. We map our notion of temporal transparency to time series changepoint detection methods, and develop a framework to detect policy changes in real-world DMS's. Experiments on New York Stop-question-and-frisk dataset reveal a number of publicly announced and unannounced policy changes, highlighting the utility of our framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Five policy uses of algorithmic transparency and explainability
The notion that algorithmic systems should be "transparent" and "explainable" is common in the many statements of consensus principles developed by governments, companies, and advocacy organizations. But what exactly do …
The Limits of AI Data Transparency Policy: Three Disclosure Fallacies
Data transparency has emerged as a rallying cry for addressing concerns about AI: data quality, privacy, and copyright chief among them. Yet while these calls are crucial for accountability, current transparency policies…
A simple declarative model of the Federal Disaster Assistance Policy -- modelling and measuring transparency
In this paper we will provide a quantitative analysis of a simple model of the Federal Disaster Assistance policy from the viewpoint of three different stakeholders. This quantitative methodology is new and has applicati…
Autoencoding Word Representations through Time for Semantic Change Detection
Semantic change detection concerns the task of identifying words whose meaning has changed over time. The current state-of-the-art detects the level of semantic change in a word by comparing its vector representation in …
Change DetectionThe 2025 Foundation Model Transparency Index
Foundation model developers are among the world's most important companies. As these companies become increasingly consequential, how do their transparency practices evolve? The 2025 Foundation Model Transparency Index i…