paper-with-me

홈 › Papers

ParaRNN: An Interpretable and Parallelizable Recurrent Neural Network for Time-Dependent Data

2026-05-04 · Yuxi Cai, Lan Li, Feiqing Huang, Guodong Li arxiv

The proliferation of large-scale and structurally complex data has spurred the integration of machine learning methods into statistical modeling. Recurrent neural networks (RNNs), a foundational class of models for time-dependent data, can be viewed as nonlinear extensions of classical autoregressive moving average models. Despite their flexibility and empirical success in machine learning, RNNs often suffer from limited interpretability and slow training, which hinders their use in statistics. This paper proposes the Parallelized RNN (ParaRNN), a novel model composed of multiple small recurrent units. ParaRNN admits an additive representation that decouples recurrent dynamics into interpretable components, whose behavior can be characterized through recurrence features. This interpretability enables its applications in nonparametric regression for time-dependent data, while the design also allows efficient parallelization. The approximation capacity and non-asymptotic prediction error bounds in a nonparametric regression setting are established for ParaRNN. Empirical results on three sequential modeling tasks further demonstrate that ParaRNN achieves performance comparable to vanilla RNNs while offering improved interpretability and efficiency.

📄 PDF Abstract BibTeX arXiv:2605.02692

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ParaRNN: Unlocking Parallel Training of Nonlinear RNNs for Large Language Models

2025-10-24 · Federico Danieli, Pau Rodriguez, Miguel Sarabia, Xavier Suau 외 arxiv

Recurrent Neural Networks (RNNs) laid the foundation for sequence modeling, but their intrinsic sequential nature restricts parallel computation, creating a fundamental barrier to scaling. This has led to the dominance o…

Improving the Performance and Learning Stability of Parallelizable RNNs Designed for Ultra-Low Power Applications

2026-05-12 · Julien Brandoit, Arthur Fyon, Damien Ernst, Guillaume Drion arxiv

Sequence learning is dominated by Transformers and parallelizable recurrent neural networks (RNNs) such as state-space models, yet learning long-term dependencies remains challenging, and state-of-the-art designs trade p…

Parallelizable memory recurrent units

2026-01-14 · Florent De Geeter, Gaspard Lambrechts, Damien Ernst, Guillaume Drion arxiv

With the emergence of massively parallel processing units, parallelization has become a desirable property for new sequence models. The ability to parallelize the processing of sequences with respect to the sequence leng…

Behavior-Dependent Linear Recurrent Units for Efficient Sequential Recommendation

2024-06-18 · Chengkai Liu, Jianghao Lin, Hanzhou Liu, Jianling Wang 외

Sequential recommender systems aims to predict the users' next interaction through user behavior modeling with various operators like RNNs and attentions. However, existing models generally fail to achieve the three gold…

Recommendation SystemsSequential Recommendation

Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection

2022-12-08 · Sasipim Srivallapanondh, Pedro J. Freire, Bernhard Spinnler, Nelson Costa 외

To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decreas…

Knowledge Distillation