Online makespan minimization in MapReduce-like systems with unsplit map tasks

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper studies an online over-list model of the makespan minimization in MapReduce-like systems with unsplit map tasks. In this paper, we assume that each job has k map tasks. We study two cases: the first is that each job has only one reduce task which cannot be divided; the second is that each job has one reduce task which can be divided into a series of reduce task parts based on its input. For the first case, we propose a \left(2-\frac{1}{h}\right)-competitive algorithm, and prove the algorithm is optimal, where h is the number of machines. For the second case, we prove that any algorithm has a competitive ratio at least 2- \frac{1}{\beta h}, where \beta is the minimax ratio between the processing time of those reduce task parts from reduce task RJ which are assigned in machine i and the processing time of the reduce task RJ for arbitrary i and j, \beta\leq \frac{\lceil\frac{k}{2}\rceil}{k-1}. We then present an optimal algorithm.

Original languageEnglish
Title of host publicationProceedings of the 2019 International Conference on Industrial Engineering and Systems Management, IESM 2019
EditorsFeifeng Zheng, Feng Chu, Ming Liu
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728115665
DOIs
StatePublished - Sep 2019
Event2019 International Conference on Industrial Engineering and Systems Management, IESM 2019 - Shanghai, China
Duration: 25 Sep 201927 Sep 2019

Publication series

NameProceedings of the 2019 International Conference on Industrial Engineering and Systems Management, IESM 2019

Conference

Conference2019 International Conference on Industrial Engineering and Systems Management, IESM 2019
Country/TerritoryChina
CityShanghai
Period25/09/1927/09/19

Keywords

  • MapReduce
  • Online algorithm
  • Scheduling

Fingerprint

Dive into the research topics of 'Online makespan minimization in MapReduce-like systems with unsplit map tasks'. Together they form a unique fingerprint.

Cite this