Inference, Prediction, and Entropy-Rate Estimation of Continuous-time, Discrete-event Processes

2020-05-07 · S. E. Marzen, J. P. Crutchfield

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network's universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

📄 PDF Abstract BibTeX arXiv:2005.03750

Code (0)

등록된 구현이 없습니다.

INFERENCE, PREDICTION, AND ENTROPY RATE OF CONTINUOUS-TIME, DISCRETE-EVENT PROCESSES

2020-01-01 · ICLR 2020 1 · Sarah Marzen, James P. Crutchfield

The inference of models, prediction of future symbols, and entropy rate estimation of discrete-time, discrete-event processes is well-worn ground. However, many time series are better conceptualized as continuous-time, d…

Prediction Time Series Time Series Analysis

End-to-End Balancing for Causal Continuous Treatment-Effect Estimation

2021-07-27 · Mohammad Taha Bahadori, Eric Tchetgen Tchetgen, David E. Heckerman

We study the problem of observational causal inference with continuous treatments in the framework of inverse propensity-score weighting. To obtain stable weights, we design a new algorithm based on entropy balancing tha…

Causal Inference

On the Estimation of Information Measures of Continuous Distributions

2020-02-07 · Georg Pichler, Pablo Piantanida, Günther Koliander

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensio…

Promoting Stochasticity for Expressive Policies via a Simple and Efficient Regularization Method

2020-12-01 · NeurIPS 2020 12 · Qi Zhou, Yufei Kuang, Zherui Qiu, Houqiang Li 외

Many recent reinforcement learning (RL) methods learn stochastic policies with entropy regularization for exploration and robustness. However, in continuous action spaces, integrating entropy regularization with expressi…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning (RL)

AR-DAE: Towards Unbiased Neural Entropy Gradient Estimation

2020-06-09 · ICML 2020 1 · Jae Hyun Lim, Aaron Courville, Christopher Pal, Chin-wei Huang

Entropy is ubiquitous in machine learning, but it is in general intractable to compute the entropy of the distribution of an arbitrary continuous random variable. In this paper, we propose the amortized residual denoisin…

continuous-control Continuous Control Denoising Density Estimation