paper-with-me

홈 › Papers

Likelihood-based inference and forecasting for trawl processes: a stochastic optimization approach

2023-08-30 · Dan Leonte, Almut E. D. Veraart

We consider trawl processes, which are stationary and infinitely divisible stochastic processes and can describe a wide range of statistical properties, such as heavy tails and long memory. In this paper, we develop the first likelihood-based methodology for the inference of real-valued trawl processes and introduce novel deterministic and probabilistic forecasting methods. Being non-Markovian, with a highly intractable likelihood function, trawl processes require the use of composite likelihood functions to parsimoniously capture their statistical properties. We formulate the composite likelihood estimation as a stochastic optimization problem for which it is feasible to implement iterative gradient descent methods. We derive novel gradient estimators with variances that are reduced by several orders of magnitude. We analyze both the theoretical properties and practical implementation details of these estimators and release a Python library which can be used to fit a large class of trawl processes. In a simulation study, we demonstrate that our estimators outperform the generalized method of moments estimators in terms of both parameter estimation error and out-of-sample forecasting error. Finally, we formalize a stochastic chain rule for our gradient estimators. We apply the new theory to trawl processes and provide a unified likelihood-based methodology for the inference of both real-valued and integer-valued trawl processes.

📄 PDF Abstract BibTeX arXiv:2308.16092

Code (1)

danleonte/ambit_stochastics 공식 구현 jax

Tasks

parameter estimationStochastic Optimization

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Simulation-based inference via telescoping ratio estimation for trawl processes

2025-10-05 · Dan Leonte, Raphaël Huser, Almut E. D. Veraart arxiv

The growing availability of large and complex datasets has increased interest in temporal stochastic processes that can capture stylized facts such as marginal skewness, non-Gaussian tails, long memory, and even non-Mark…

Gaussian Processes

Nested Variational Compression in Deep Gaussian Processes

2014-12-03 · James Hensman, Neil D. Lawrence

Deep Gaussian processes provide a flexible approach to probabilistic modelling of data using either supervised or unsupervised learning. For tractable inference approximations to the marginal likelihood of the model must…

Gaussian ProcessesVariational Inference

Quadruply Stochastic Gaussian Processes

2020-06-04 · Trefor W. Evans, Prasanth B. Nair

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis …

Gaussian ProcessesregressionStochastic OptimizationVariational Inference

Deep Neyman-Scott Processes

2021-11-06 · Chengkuan Hong, Christian R. Shelton

A Neyman-Scott process is a special case of a Cox process. The latent and observable stochastic processes are both Poisson processes. We consider a deep Neyman-Scott process in this paper, for which the building componen…

Point Processes

TRAWL: Tensor Reduced and Approximated Weights for Large Language Models

2024-06-25 · Yiran Luo, Het Patel, Yu Fu, Dawon Ahn 외

Recent research has shown that pruning large-scale language models for inference is an effective approach to improving model efficiency, significantly reducing model weights with minimal impact on performance. Interestin…

Language ModellingLarge Language ModelModel OptimizationTensor Decomposition