Mamba Hawkes Process
Irregular and asynchronous event sequences are prevalent in many domains, such as social media, finance, and healthcare. Traditional temporal point processes (TPPs), like Hawkes processes, often struggle to model mutual inhibition and nonlinearity effectively. While recent neural network models, including RNNs and Transformers, address some of these issues, they still face challenges with long-term dependencies and computational efficiency. In this paper, we introduce the Mamba Hawkes Process (MHP), which leverages the Mamba state space architecture to capture long-range dependencies and dynamic event interactions. Our results show that MHP outperforms existing models across various datasets. Additionally, we propose the Mamba Hawkes Process Extension (MHP-E), which combines Mamba and Transformer models to enhance predictive capabilities. We present the novel application of the Mamba architecture to Hawkes processes, a flexible and extensible model structure, and a theoretical analysis of the synergy between state space models and Hawkes processes. Experimental results demonstrate the superior performance of both MHP and MHP-E, advancing the field of temporal point process modeling.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyMambaPoint ProcessesState Space ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Non-Parametric Estimation of Multi-dimensional Marked Hawkes Processes
An extension of the Hawkes process, the Marked Hawkes process distinguishes itself by featuring variable jump size across each event, in contrast to the constant jump size observed in a Hawkes process without marks. Whil…
Variance-Hawkes Process and its Application to Energy Markets
We define a new model using a Hawkes process as a subordinator in a standard Brownian motion. We demonstrate that this Hawkes subordinated Brownian motion or more succinctly, variance-Hawkes process can be fit to 2018 an…
MUFM: A Mamba-Enhanced Feedback Model for Micro Video Popularity Prediction
The surge in micro-videos is transforming the concept of popularity. As researchers delve into vast multi-modal datasets, there is a growing interest in understanding the origins of this popularity and the forces driving…
MambaContinuous-Time Reinforcement Learning for Controlled Hawkes Jump-Diffusions
We study stochastic control of multivariate Hawkes-driven stochastic differential equations with machine learning algorithms in a non-Markovian setting. Due to the path dependence of the memory of the Hawkes intensity, t…
Reinforcement LearningApplication of Hawkes volatility in the observation of filtered high-frequency price process in tick structures
The Hawkes model is suitable for describing self and mutually exciting random events. In addition, the exponential decay in the Hawkes process allows us to calculate the moment properties in the model. However, due to th…
Management