Open Access Repository
A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud
Altmetric
Altmetric
ORCID: 0000-0001-7688-332X, Liu, P, Penesis, I ORCID: 0000-0003-4570-6034 and He, G 2019
, 'A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud'
, IEEE Access, vol. 7
, pp. 127943-127955
, doi: https://doi.org/10.1109/ACCESS.2019.2939903.
|
PDF
(Published version)
144324 - A task...pdf | Download (1MB) | Preview |
Abstract
CPU time has long been a remaining problem for large-scale batch mode based scientific computing applications. To address this time-consuming problem, a container-based private cloud was employed, and a novel task-resource mapping algorithm was developed. Firstly, the execution features of typical batch mode codes were extracted and then computing jobs were formulated as a coarseness acyclic DAG. Secondly, to guarantee both job makespan and resource utilization, a novel task-resource mapping algorithm, along with container pre-planning and worst-case-first task placement phases, were developed. Finally, a typical Computational Marine Hydrodynamics software, Rotorysics, with a different scale of input data matrix was used as benchmark software. To manifest the effectiveness of the proposed method, a number of numerical examples were given via CloudSim and a small-medium containerized private cloud platform was adopted with three practical study cases. The computational results show that 1) compared with the traditional HPC workstation computing solution, container-based cloud solution shows significant savings in makespan by more than 6 times. 2) the new method is scalable to address bigger size batch computing problem up to a run matrix 108,.
| Item Type: | Article |
|---|---|
| Authors/Creators: | Xu, Y and Liu, P and Penesis, I and He, G |
| Keywords: | computational marine hydrodynamics (CMH) codes, containerization, large-scale batch mode computing, private cloud, task-resource mapping algorithm |
| Journal or Publication Title: | IEEE Access |
| Publisher: | Institute of Electrical and Electronics Engineers |
| ISSN: | 2169-3536 |
| DOI / ID Number: | https://doi.org/10.1109/ACCESS.2019.2939903 |
| Copyright Information: | © 2021. The Authors. This is an open access article under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) License, (https://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
| Related URLs: | |
| Item Statistics: | View statistics for this item |
Actions (login required)
 |
Item Control Page |