paper-with-me

홈 › Papers

DCILP: A Distributed Approach for Large-Scale Causal Structure Learning

2024-06-15 · Shuyu Dong, Michèle Sebag, Kento Uemura, Akito Fujii, Shuang Chang, Yusuke Koyanagi, Koji Maruhashi

Causal learning tackles the computationally demanding task of estimating causal graphs. This paper introduces a new divide-and-conquer approach for causal graph learning, called DCILP. In the divide phase, the Markov blanket MB($X_i$) of each variable $X_i$ is identified, and causal learning subproblems associated with each MB($X_i$) are independently addressed in parallel. This approach benefits from a more favorable ratio between the number of data samples and the number of variables considered. In counterpart, it can be adversely affected by the presence of hidden confounders, as variables external to MB($X_i$) might influence those within it. The reconciliation of the local causal graphs generated during the divide phase is a challenging combinatorial optimization problem, especially in large-scale applications. The main novelty of DCILP is an original formulation of this reconciliation as an integer linear programming (ILP) problem, which can be delegated and efficiently handled by an ILP solver. Through experiments on medium to large scale graphs, and comparisons with state-of-the-art methods, DCILP demonstrates significant improvements in terms of computational complexity, while preserving the learning accuracy on real-world problem and suffering at most a slight loss of accuracy on synthetic problems.

📄 PDF Abstract BibTeX arXiv:2406.10481

Code (0)

등록된 구현이 없습니다.

Tasks

Causal DiscoveryCombinatorial OptimizationGraph Learning

Similar Papers 제목 키워드 기반

Distributed Learning of Generalized Linear Causal Networks

2022-01-23 · Qiaoling Ye, Arash A. Amini, Qing Zhou

We consider the task of learning causal structures from data stored on multiple machines, and propose a novel structure learning method called distributed annealing on regularized likelihood score (DARLS) to solve this p…

Distributed Optimization

Large-Scale Local Causal Inference of Gene Regulatory Relationships

2019-09-03 · Ioan Gabriel Bucur, Tom Claassen, Tom Heskes

Gene regulatory networks play a crucial role in controlling an organism's biological processes, which is why there is significant interest in developing computational methods that are able to extract their structure from…

Causal InferenceTriplet

Scalable Linear Causal Inference for Irregularly Sampled Time Series with Long Range Dependencies

2016-03-10 · Francois W. Belletti, Evan R. Sparks, Michael J. Franklin, Alexandre M. Bayen 외

Linear causal analysis is central to a wide range of important application spanning finance, the physical sciences, and engineering. Much of the existing literature in linear causal analysis operates in the time domain. …

Causal InferenceTime SeriesTime Series Analysis

Interpretability at Scale: Identifying Causal Mechanisms in Alpaca

2023-05-15 · NeurIPS 2023 11 · Zhengxuan Wu, Atticus Geiger, Thomas Icard, Christopher Potts 외

Obtaining human-interpretable explanations of large, general-purpose language models is an urgent goal for AI safety. However, it is just as important that our interpretability methods are faithful to the causal dynamics…

A partial order view of message-passing communication models

2022-10-24 · Cinzia Di Giusto, Davide Ferré, Laetitia Laversa, Etienne Lozes

There is a wide variety of message-passing communication models, ranging from synchronous ''rendez-vous'' communications to fully asynchronous/out-of-order communications. For large-scale distributed systems, the communi…

Distributed Computing