paper-with-me

홈 › Papers

Towards Learned Predictability of Storage Systems

2023-07-30 · Chenyuan Wu

With the rapid development of cloud computing and big data technologies, storage systems have become a fundamental building block of datacenters, incorporating hardware innovations such as flash solid state drives and non-volatile memories, as well as software infrastructures such as RAID and distributed file systems. Despite the growing popularity and interests in storage, designing and implementing reliable storage systems remains challenging, due to their performance instability and prevailing hardware failures. Proactive prediction greatly strengthens the reliability of storage systems. There are two dimensions of prediction: performance and failure. Ideally, through detecting in advance the slow IO requests, and predicting device failures before they really happen, we can build storage systems with especially low tail latency and high availability. While its importance is well recognized, such proactive prediction in storage systems, on the other hand, is particularly difficult. To move towards predictability of storage systems, various mechanisms and field studies have been proposed in the past few years. In this report, we present a survey of these mechanisms and field studies, focusing on machine learning based black-box approaches. Based on three representative research works, we discuss where and how machine learning should be applied in this field. The strengths and limitations of each research work are also evaluated in detail.

📄 PDF Abstract BibTeX arXiv:2307.16288

Code (0)

등록된 구현이 없습니다.

Tasks

Cloud Computing

Similar Papers 제목 키워드 기반

The Holistic Storage of Verb+Up Phrases in Text-based and Audio-based Language Models

2026-06-12 · Zachary Nicholas Houghton, Yu Zhou, Dan Pluth, Vijay K. Gurbani arxiv

A crucial aspect of linguistic capability is the ability to trade off between stored representations and abstract knowledge: one must retrieve learned representations, but also generate novel ones by applying productive …

Predictability and Fairness in Load Aggregation and Operations of Virtual Power Plants

2021-10-06 · Jakub Marecek, Michal Roubalik, Ramen Ghosh, Robert N. Shorten 외

In power systems, one wishes to regulate the aggregate demand of an ensemble of distributed energy resources (DERs), such as controllable loads and battery energy storage systems. We suggest a notion of predictability an…

Fairness

Information dynamics of price and liquidity around the 2017 Bitcoin markets crash

2021-11-17 · Vaiva Vasiliauskaite, Fabrizio Lillo, Nino Antulov-Fantulin

We study the information dynamics between the largest Bitcoin exchange markets during the bubble in 2017-2018. By analysing high-frequency market-microstructure observables with different information theoretic measures f…

On the Confidence in Bit-Alias Measurement of Physical Unclonable Functions

2020-01-21

Physical Unclonable Functions (PUFs) are modern solutions for cheap and secure key storage. The security level strongly depends on a PUF's unpredictability, which is impaired if certain bits of the PUF response tend towa…

LearnedKV: Integrating LSM and Learned Index for Superior Performance on Storage

2024-06-27 · Wenlong Wang, David Hung-Chang Du

We present LearnedKV, a novel tiered key-value store that seamlessly integrates a Log-Structured Merge (LSM) tree with a Learned Index to achieve superior read and write performance on storage systems. While existing app…

Blocking