Open Access Repository

A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud

Downloads

Downloads per month over past year

Xu, Y, Liu, P, Penesis, I ORCID: 0000-0003-4570-6034 and He, G 2019 , 'A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud' , IEEE Access, vol. 7 , pp. 127943-127955 , doi: 10.1109/ACCESS.2019.2939903.

[img]
Preview
PDF (Published version)
144324 - A task...pdf | Download (1MB)

| Preview

Abstract

CPU time has long been a remaining problem for large-scale batch mode based scientific computing applications. To address this time-consuming problem, a container-based private cloud was employed, and a novel task-resource mapping algorithm was developed. Firstly, the execution features of typical batch mode codes were extracted and then computing jobs were formulated as a coarseness acyclic DAG. Secondly, to guarantee both job makespan and resource utilization, a novel task-resource mapping algorithm, along with container pre-planning and worst-case-first task placement phases, were developed. Finally, a typical Computational Marine Hydrodynamics software, Rotorysics, with a different scale of input data matrix was used as benchmark software. To manifest the effectiveness of the proposed method, a number of numerical examples were given via CloudSim and a small-medium containerized private cloud platform was adopted with three practical study cases. The computational results show that 1) compared with the traditional HPC workstation computing solution, container-based cloud solution shows significant savings in makespan by more than 6 times. 2) the new method is scalable to address bigger size batch computing problem up to a run matrix 108,.

Item Type: Article
Authors/Creators:Xu, Y and Liu, P and Penesis, I and He, G
Keywords: computational marine hydrodynamics (CMH) codes, containerization, large-scale batch mode computing, private cloud, task-resource mapping algorithm
Journal or Publication Title: IEEE Access
Publisher: Institute of Electrical and Electronics Engineers
ISSN: 2169-3536
DOI / ID Number: 10.1109/ACCESS.2019.2939903
Copyright Information:

© 2021. The Authors. This is an open access article under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) License, (https://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Related URLs:
Item Statistics: View statistics for this item

Actions (login required)

Item Control Page Item Control Page
TOP