paper-with-me

Papers

Bootstrap aggregation and confidence measures to improve time series causal discovery

2023-06-15 · Kevin Debeire, Jakob Runge, Andreas Gerhardus, Veronika Eyring

Learning causal graphs from multivariate time series is a ubiquitous challenge in all application domains dealing with time-dependent systems, such as in Earth sciences, biology, or engineering, to name a few. Recent developments for this causal discovery learning task have shown considerable skill, notably the specific time-series adaptations of the popular conditional independence-based learning framework. However, uncertainty estimation is challenging for conditional independence-based methods. Here, we introduce a novel bootstrap approach designed for time series causal discovery that preserves the temporal dependencies and lag structure. It can be combined with a range of time series causal discovery methods and provides a measure of confidence for the links of the time series graphs. Furthermore, next to confidence estimation, an aggregation, also called bagging, of the bootstrapped graphs by majority voting results in bagged causal discovery methods. In this work, we combine this approach with the state-of-the-art conditional-independence-based algorithm PCMCI+. With extensive numerical experiments we empirically demonstrate that, in addition to providing confidence measures for links, Bagged-PCMCI+ improves in precision and recall as compared to its base algorithm PCMCI+, at the cost of higher computational demands. These statistical performance improvements are especially pronounced in the more challenging settings (short time sample size, large number of variables, high autocorrelation). Our bootstrap approach can also be combined with other time series causal discovery algorithms and can be of considerable use in many real-world applications.

📄 PDF Abstract BibTeX arXiv:2306.08946

Code (1)

eyringmlclimategroup/debeire24clear_bagged_timeseries_causality 공식 구현

Tasks

Causal DiscoveryTime Series

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Confidence Intervals for Evaluation of Data Mining

2025-02-10 · Zheng Yuan, Wenxin Jiang

In data mining, when binary prediction rules are used to predict a binary outcome, many performance measures are used in a vast array of literature for the purposes of evaluation and comparison. Some examples include cla…

Causal Discovery on Higher-Order Interactions

2025-11-18 · Alessio Zanga, Marco Scutari, Fabio Stella arxiv

Causal discovery combines data with knowledge provided by experts to learn the DAG representing the causal relationships between a given set of variables. When data are scarce, bagging is used to measure our confidence i…

LLM Confidence Evaluation Measures in Zero-Shot CSS Classification

2024-10-16 · David Farr, Iain Cruickshank, Nico Manzonelli, Nicholas Clark 외

Assessing classification confidence is critical for leveraging large language models (LLMs) in automated labeling tasks, especially in the sensitive domains presented by Computational Social Science (CSS) tasks. In this …

Uncertainty Quantification

Joint Bootstrapping Machines for High Confidence Relation Extraction

2018-05-01 · NAACL 2018 6 · Pankaj Gupta, Benjamin Roth, Hinrich Schütze

Semi-supervised bootstrapping techniques for relationship extraction from text iteratively expand a set of initial seed instances. Due to the lack of labeled data, a key challenge in bootstrapping is semantic drift: if a…

RelationRelation ExtractionRelationship Extraction (Distant Supervised)Vocal Bursts Intensity Prediction

Estimating Uncertainty in Classifier Performance with Applications to Large Language Models and Nested Data

2026-06-24 · Kylie Anglin arxiv

Researchers increasingly use text classification--supervised models or large language models--to measure constructs from natural language, providing metrics such as recall and precision as evidence of their validity. Yet…

Text Classification