Fine-Grained Address Segmentation for Attention-Based Variable-Degree Prefetching
Machine learning algorithms have shown potential to improve prefetching performance by accurately predicting future memory accesses. Existing approaches are based on the modeling of text prediction, considering prefetching as a classification problem for sequence prediction. However, the vast and sparse memory address space leads to large vocabulary, which makes this modeling impractical. The number and order of outputs for multiple cache line prefetching are also fundamentally different from text prediction. We propose TransFetch, a novel way to model prefetching. To reduce vocabulary size, we use fine-grained address segmentation as input. To predict unordered sets of future addresses, we use delta bitmaps for multiple outputs. We apply an attention-based network to learn the mapping between input and output. Prediction experiments demonstrate that address segmentation achieves 26% - 36% higher F1-score than delta inputs and 15% - 24% higher F1-score than page & offset inputs for SPEC 2006, SPEC 2017, and GAP benchmarks. Simulation results show that TransFetch achieves 38.75% IPC improvement compared with no prefetching, outperforming the best-performing rule-based prefetcher BOP by 10.44%, and ML-based prefetcher Voyager by 6.64%.
Code (1)
Tasks
PredictionSegmentationSimilar Papers 제목 키워드 기반
FGAseg: Fine-Grained Pixel-Text Alignment for Open-Vocabulary Semantic Segmentation
Open-vocabulary segmentation aims to identify and segment specific regions and objects based on text-based descriptions. A common solution is to leverage powerful vision-language models (VLMs), such as CLIP, to bridge th…
Open Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentationSemantic SegmentationCAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation
Colorectal polyp segmentation can help physicians screen colonoscopy images, which is essential for preventing colorectal cancer. The segmentation of polyps encounters multiple challenges, like small size, uneven brightn…
CAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation
Colorectal polyp segmentation can help physicians screen colonoscopy images, which is essential for preventing colorectal cancer. The segmentation of polyps encounters multiple challenges, like small size, uneven brightn…
Focus-Constrained Attention Mechanism for CVAE-based Response Generation
To model diverse responses for a given post, one promising way is to introduce a latent variable into Seq2Seq models. The latent variable is supposed to capture the discourse-level information and encourage the informati…
DecoderInformativenessResponse GenerationFine-grained Action Segmentation using the Semi-Supervised Action GAN
In this paper we address the problem of continuous fine-grained action segmentation, in which multiple actions are present in an unsegmented video stream. The challenge for this task lies in the need to represent the hie…
Action ClassificationAction SegmentationGenerative Adversarial NetworkSegmentation