Scaling Power Management in Cloud Data Centers: A Multi-Level Continuous-Time MDP Approach
Chitsaz B. Khonsari A. Moradian M. Dadlani A. Talebi M.S.
2024Institute of Electrical and Electronics Engineers Inc.
IEEE Transactions on Services Computing
2024#17Issue 41753 - 1765 pp.
Power management in multi-server data centers especially at scale is a vital issue of increasing importance in cloud computing paradigm. Existing studies mostly consider thresholds on the number of idle servers to switch the servers on or off and suffer from scalability issues. As a natural approach in view of the Markovian assumption, we present a multi-level continuous-time Markov decision process (CTMDP) model based on state aggregation of multi-server data centers with setup times that interestingly overcomes the inherent intractability of traditional MDP approaches due to their colossal state-action space. The beauty of the presented model is that, while it keeps loyalty to the Markovian behavior, it approximates the calculation of the transition probabilities in a way that keeps the accuracy of the results at a desirable level. Moreover, near-optimal performance is attained at the expense of the increased state-space dimensionality by tuning the number of levels in the multi-level approach. The simulation results were promising and confirm that in many scenarios of interest, the proposed approach attains noticeable improvements, namely a near 50% reduction in the size of CTMDP while yielding better rewards as compared to existing fixed threshold-based policies and aggregation methods.
Cloud data centers , Markov decision process , power management , setup time , state aggregation
Text of the article Перейти на текст статьи
University of Tehran, School of Electrical and Computer Engineering, College of Engineering, Tehran, 14155-6619, Iran
Institute for Research in Fundamental Sciences, School of Computer Science, Tehran, 19538-33511, Iran
K. N. Toosi University of Technology, School of Computer Engineering, Tehran, 15418-49611, Iran
University of Alberta, Department of Computing Science, Edmonton, T6G 2E8, AB, Canada
Nazarbayev University, Department of Electrical and Computer Engineering, Astana, 010000, Kazakhstan
University of Copenhagen, Department of Computer Science, Copenhagen, 1165, Denmark
University of Tehran
Institute for Research in Fundamental Sciences
K. N. Toosi University of Technology
University of Alberta
Nazarbayev University
University of Copenhagen
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026