SaFARi: State-Space Models for Frame-Agnostic Representation
State-Space Models (SSMs) have re-emerged as a powerful tool for online function approximation, and as the backbone of machine learning models for long-range dependent data. However, to date, only a few polynomial bases have been explored for this purpose, and the state-of-the-art implementations were built upon the best of a few limited options. In this paper, we present a generalized method for building an SSM with any frame or basis, rather than being restricted to polynomials. This framework encompasses the approach known as HiPPO, but also permits an infinite diversity of other possible "species" within the SSM architecture. We dub this approach SaFARi: SSMs for Frame-Agnostic Representation.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityState Space ModelsSimilar Papers 제목 키워드 기반
SAFARI: Scaling Long Horizon Agentic Fault Attribution via Active Investigation
As autonomous agents tackle increasingly complex multi-step, multi-agent tasks, their execution trajectories have scaled beyond the constraints of even the largest context windows. Current methods for effectively diagnos…
WaLRUS: Wavelets for Long-range Representation Using SSMs
State-Space Models (SSMs) have proven to be powerful tools for modeling long-range dependencies in sequential data. While the recent method known as HiPPO has demonstrated strong performance, and formed the basis for mac…
DiversityMambaState Space ModelsOne Swallow Does Not Make a Summer: Understanding Semantic Structures in Embedding Spaces
Embedding spaces are fundamental to modern AI, translating raw data into high-dimensional vectors that encode rich semantic relationships. Yet, their internal structures remain opaque, with existing approaches often sacr…
Bias DetectionApproximate Model-Based Diagnosis Using Greedy Stochastic Search
We propose a StochAstic Fault diagnosis AlgoRIthm, called SAFARI, which trades off guarantees of computing minimal diagnoses for computational efficiency. We empirically demonstrate, using the 74XXX and ISCAS-85 suites o…
Computational EfficiencyFault DiagnosisNo Free Lunch But A Cheaper Supper: A General Framework for Streaming Anomaly Detection
In recent years, there has been increased research interest in detecting anomalies in temporal streaming data. A variety of algorithms have been developed in the data mining community, which can be divided into two categ…
Anomaly Detection