paper-with-me

Papers

A Reinforcement Learning-Based Task Mapping Method to Improve the Reliability of Clustered Manycores

2024-12-26 · Fatemeh Hossein-Khani, Omid Akbari

The increasing scale of manycore systems poses significant challenges in managing reliability while meeting performance demands. Simultaneously, these systems become more susceptible to different aging mechanisms such as negative-bias temperature instability (NBTI), hot carrier injection (HCI), and thermal cycling (TC), as well as the electromigration (EM) phenomenon. In this paper, we propose a reinforcement learning (RL)-based task mapping method to improve the reliability of manycore systems considering the aforementioned aging mechanisms, which consists of three steps including bin packing, task-to-bin mapping, and task-to-core mapping. In the initial step, a density-based spatial application with noise (DBSCAN) clustering method is employed to compose some clusters (bins) based on the cores temperature. Then, the Q-learning algorithm is used for the two latter steps, to map the arrived task on a core such that the minimum thermal variation is occurred among all the bins. Compared to the state-of-the-art works, the proposed method is performed during runtime without requiring any parameter to be calculated offline. The effectiveness of the proposed technique is evaluated on 16, 32, and 64 cores systems using SPLASH2 and PARSEC benchmark suite applications. The results demonstrate up to 27% increase in the mean time to failure (MTTF) compared to the state-of-the-art task mapping techniques.

📄 PDF Abstract BibTeX arXiv:2412.19340

Code (0)

등록된 구현이 없습니다.

Tasks

Q-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Discontinuity-Sensitive Optimal Control Learning by Mixture of Experts

2018-03-07 · Gao Tang, Kris Hauser

This paper proposes a discontinuity-sensitive approach to learn the solutions of parametric optimal control problems with high accuracy. Many tasks, ranging from model predictive control to reinforcement learning, may be…

Mixture-of-ExpertsModel Predictive ControlReinforcement Learning

Clustered Calibration: Representation-Aware Probability Calibration via Learned Subpopulations

2025-10-22 · Tomer Lavi, Bracha Shapira, Nadav Rappoport arxiv

Ensuring that predicted probabilities align with observed frequencies is critical in high-stakes domains such as clinical decision support, autonomous driving and financial risk assessment. Existing calibration methods t…

Autonomous Driving

Efficient sparse semismooth Newton methods for the clustered lasso problem

2018-08-22 · Meixia Lin, Yong-Jin Liu, Defeng Sun, Kim-Chuan Toh

We focus on solving the clustered lasso problem, which is a least squares problem with the $\ell_1$-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regre…

Driving Style Encoder: Situational Reward Adaptation for General-Purpose Planning in Automated Driving

2019-12-07 · Sascha Rosbach, Vinit James, Simon Großjohann, Silviu Homoceanu 외

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward function…

Model Predictive ControlMotion PlanningReinforcement Learning

Transformation & Translation Occupancy Grid Mapping: 2-Dimensional Deep Learning Refined SLAM

2025-04-28 · Leon Davies, Baihua Li, Mohamad Saada, Simon Sølvsten 외

SLAM (Simultaneous Localisation and Mapping) is a crucial component for robotic systems, providing a map of an environment, the current location and previous trajectory of a robot. While 3D LiDAR SLAM has received notabl…

Deep Reinforcement LearningPose Estimation