paper-with-me

홈 › Papers

Inferring Kernel $ε$-Machines: Discovering Structure in Complex Systems

2024-10-01 · Alexandra M. Jurgens, Nicolas Brodu

Previously, we showed that computational mechanic's causal states -- predictively-equivalent trajectory classes for a stochastic dynamical system -- can be cast into a reproducing kernel Hilbert space. The result is a widely-applicable method that infers causal structure directly from very different kinds of observations and systems. Here, we expand this method to explicitly introduce the causal diffusion components it produces. These encode the kernel causal-state estimates as a set of coordinates in a reduced dimension space. We show how each component extracts predictive features from data and demonstrate their application on four examples: first, a simple pendulum -- an exactly solvable system; second, a molecular-dynamic trajectory of $n$-butane -- a high-dimensional system with a well-studied energy landscape; third, the monthly sunspot sequence -- the longest-running available time series of direct observations; and fourth, multi-year observations of an active crop field -- a set of heterogeneous observations of the same ecosystem taken for over a decade. In this way, we demonstrate that the empirical kernel causal-states algorithm robustly discovers predictive structures for systems with widely varying dimensionality and stochasticity.

📄 PDF Abstract BibTeX arXiv:2410.01076

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Bayesian Structural Inference for Hidden Processes

2013-09-05 · Christopher C. Strelioff, James P. Crutchfield

We introduce a Bayesian approach to discovering patterns in structurally complex processes. The proposed method of Bayesian Structural Inference (BSI) relies on a set of candidate unifilar HMM (uHMM) topologies for infer…

Iteratively reweighted kernel machines efficiently learn sparse functions

2025-05-13 · Libin Zhu, Damek Davis, Dmitriy Drusvyatskiy, Maryam Fazel

The impressive practical performance of neural networks is often attributed to their ability to learn low-dimensional data representations and hierarchical structure directly from data. In this work, we argue that these …

Optimizing Kernel Machines using Deep Learning

2017-11-15 · Huan Song, Jayaraman J. Thiagarajan, Prasanna Sattigeri, Andreas Spanias

Building highly non-linear and non-parametric models is central to several state-of-the-art machine learning systems. Kernel methods form an important class of techniques that induce a reproducing kernel Hilbert space (R…

Computational EfficiencyDeep Learning

Clusters in Explanation Space: Inferring disease subtypes from model explanations

2019-12-18 · Marc-Andre Schulz, Matt Chapman-Rounds, Manisha Verma, Danilo Bzdok 외

Identification of disease subtypes and corresponding biomarkers can substantially improve clinical diagnosis and treatment selection. Discovering these subtypes in noisy, high dimensional biomedical data is often impossi…

ClusteringDiagnostic

Evolving Flying Machines in Minecraft Using Quality Diversity

2023-02-01 · Alejandro Medina, Melanie Richey, Mark Mueller, Jacob Schrum

Minecraft is a great testbed for human creativity that has inspired the design of various structures and even functioning machines, including flying machines. EvoCraft is an API for programmatically generating structures…

DiversityMinecraft