Managing deadline-constrained bag-of-tasks jobs on hybrid clouds

  • Bo Wang
  • , Ying Song
  • , Yuzhong Sun
  • , Jun Liu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Outsourcing jobs to a public cloud is a cost-effective way to address the problem of satisfying the peak resource demand when the local cloud has insufficient resources. In this paper, we study on managing deadline-constrained bag-of-tasks jobs on hybrid clouds. We present a binary nonlinear programming (BNP) problem to model the hybrid cloud management where the utilization of physical machines (PMs) in the local cloud/cluster is maximized when the local resources are enough to satisfy the deadline constraints of jobs, while when not, the rent cost from the public cloud is minimized. To solve the BNP problem in polynomial time, we propose the heuristic algorithm whose main idea is assigning a task to a core of a used PM (in local cloud) or a rented virtual machine (VM) (in public cloud) such that the difference between the finish time of the task and its deadline is minimal in all of assignments. If none of unassigned tasks can be completed within its deadline, the algorithm adds an available PM with most capacity or rents a new VM with highest cost-performance ratio and assigns tasks to the new PM/VM as previous step. Extensive experimental results show that our heuristic algorithm saves 16.2%-76% cost and improves 47.3%-182.8% resource utilizations for finishing jobs within their respective deadlines with comparable overheads, compared with first fit decreasing algorithm.

Original languageEnglish
Title of host publicationSimulation Series
EditorsJosef Weinbub, Marc Baboulin, William Thacker, Lukas Polok, Sanjukta Bhowmick
PublisherThe Society for Modeling and Simulation International
Pages161-168
Number of pages8
Edition4
ISBN (Electronic)9781510823150, 9781510823167, 9781510823174, 9781510823181, 9781510823204, 9781510824232, 9781510824249, 9781510824256
StatePublished - 2016
Event24th High Performance Computing Symposium, HPC 2016, Part of the 2016 Spring Simulation Multi-Conference, SpringSim 2016 - Pasadena, United States
Duration: 3 Apr 20166 Apr 2016

Publication series

NameSimulation Series
Number4
Volume48
ISSN (Print)0735-9276

Conference

Conference24th High Performance Computing Symposium, HPC 2016, Part of the 2016 Spring Simulation Multi-Conference, SpringSim 2016
Country/TerritoryUnited States
CityPasadena
Period3/04/166/04/16

Keywords

  • Bag-of-tasks
  • Cloud computing
  • Hybrid cloud
  • Resource management
  • Task scheduling

Fingerprint

Dive into the research topics of 'Managing deadline-constrained bag-of-tasks jobs on hybrid clouds'. Together they form a unique fingerprint.

Cite this