paper-with-me

홈 › Papers

Deep Learning-based Approaches for State Space Models: A Selective Review

2024-12-15 · Jiahe Lin, George Michailidis

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the observations. This paper provides a selective review of recent advancements in deep neural network-based approaches for SSMs, and presents a unified perspective for discrete time deep state space models and continuous time ones such as latent neural Ordinary Differential and Stochastic Differential Equations. It starts with an overview of the classical maximum likelihood based approach for learning SSMs, reviews variational autoencoder as a general learning pipeline for neural network-based approaches in the presence of latent variables, and discusses in detail representative deep learning models that fall under the SSM framework. Very recent developments, where SSMs are used as standalone architectural modules for improving efficiency in sequence modeling, are also examined. Finally, examples involving mixed frequency and irregularly-spaced time series data are presented to demonstrate the advantage of SSMs in these settings.

📄 PDF Abstract BibTeX arXiv:2412.11211

Code (0)

등록된 구현이 없습니다.

Tasks

State Space Models

Similar Papers 제목 키워드 기반

COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigation

2025-03-31 · Siqi Zhang, Yanyuan Qiao, Qunbo Wang, Zike Yan 외

Vision-and-Language Navigation (VLN) tasks have gained prominence within artificial intelligence research due to their potential application in fields like home assistants. Many contemporary VLN approaches, while based o…

MemorizationVision and Language Navigation

Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimation

2026-01-11 · Luke S. Lagunowich, Guoxiang Grayson Tong, Daniele E. Schiavazzi arxiv

Traditional filtering algorithms for state estimation -- such as classical Kalman filtering, unscented Kalman filtering, and particle filters -- show performance degradation when applied to nonlinear systems whose uncert…

Autonomous Driving

Similarity-Aware Selective State-Space Modeling for Semantic Correspondence

2025-09-29 · Seungwook Kim, Minsu Cho arxiv

Establishing semantic correspondences between images is a fundamental yet challenging task in computer vision. Traditional feature-metric methods enhance visual features but may miss complex inter-correlation relationshi…

Semantic correspondence

Computational role of sleep in memory reorganization

2023-04-06 · Kensuke Yoshida, Taro Toyoizumi

Sleep is considered to play an essential role in memory reorganization. Despite its importance, classical theoretical models did not focus on some sleep characteristics. Here, we review recent theoretical approaches inve…

Learning Enriched Features via Selective State Spaces Model for Efficient Image Deblurring

2024-03-29 · Hu Gao, Depeng Dang

Image deblurring aims to restore a high-quality image from its corresponding blurred. The emergence of CNNs and Transformers has enabled significant progress. However, these methods often face the dilemma between elimina…

Computational EfficiencyDeblurringImage DeblurringImage Defocus Deblurring