We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Multi-stage resource-aware scheduling for data centers with heterogeneous servers.
- Authors
Tran, Tony T.; Padmanabhan, Meghana; Zhang, Peter Yun; Li, Heyse; Down, Douglas G.; Beck, J. Christopher
- Abstract
This paper presents a three-stage algorithm for resource-aware scheduling of computational jobs in a large-scale heterogeneous data center. The algorithm aims to allocate job classes to machine configurations to attain an efficient mapping between job resource request profiles and machine resource capacity profiles. The first stage uses a queueing model that treats the system in an aggregated manner with pooled machines and jobs represented as a fluid flow. The latter two stages use combinatorial optimization techniques to solve a shorter-term, more accurate representation of the problem using the first-stage, long-term solution for heuristic guidance. In the second stage, jobs and machines are discretized. A linear programming model is used to obtain a solution to the discrete problem that maximizes the system capacity given a restriction on the job class and machine configuration pairings based on the solution of the first stage. The final stage is a scheduling policy that uses the solution from the second stage to guide the dispatching of arriving jobs to machines. We present experimental results of our algorithm on both Google workload trace data and generated data and show that it outperforms existing schedulers. These results illustrate the importance of considering heterogeneity of both job and machine configuration profiles in making effective scheduling decisions.
- Subjects
COMPUTER scheduling; DATA libraries; COMPUTATIONAL complexity; JOB classification; COMBINATORIAL optimization
- Publication
Journal of Scheduling, 2018, Vol 21, Issue 2, p251
- ISSN
1094-6136
- Publication type
Article
- DOI
10.1007/s10951-017-0537-x