Two-level Dynamic Load Balancing for High Performance Scientific Applications

Mohammed, Ali and Cavelan, Aurélien and Ciorba, Florina M. and Cabezon, Ruben and Banicescu, Ioana. (2020) Two-level Dynamic Load Balancing for High Performance Scientific Applications. In: Proceedings of the 2020 SIAM Conference on Parallel Processing for Scientific Computing. pp. 69-80.

Full text not available from this repository.

Official URL: https://edoc.unibas.ch/73178/

Downloads: Statistics Overview


Scientific applications are often complex, irregular, and computationally-intensive. To accommodate their ever-increasing computational demands, the high-performance computing (HPC) systems have become larger and more complex, offering increased hardware parallelism at multiple levels (e.g., nodes, cores per node, threads per core). Scientific applications need to exploit all multilevel hardware parallelism to harness the available computational power. The performance of applications executing on such HPC systems may adversely be affected by load imbalance at multiple levels, caused by problem, algorithmic, and systemic characteristics. Existing dynamic load balancing methods do not simultaneously address load imbalance at multiple software parallelism levels. This work investigates the joint impact of load imbalance on the performance of three scientific applications at the thread and process levels. We jointly apply and evaluate selected dynamic loop self-scheduling (DLS) techniques to both levels. This approach is generic and applicable to any multiprocess-multithreaded computationally-intensive application. We conduct an exhaustive set of experiments to assess and compare the combination of six DLS techniques at the thread level and eleven at the process level. The results show that improved overall application performance, by up to 21%, can only be achieved by jointly addressing load imbalance at both software parallelism levels. We offer insights into the performance of the selected DLS techniques and discuss the interplay of dynamic load balancing at the thread and process levels.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Informatik > High Performance Computing (Ciorba)
UniBasel Contributors:Mohammed, Ali Omar Abdelazim and Cavelan, Aurélien and Ciorba, Florina M. and Cabezon, Ruben M.
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Note:Publication type according to Uni Basel Research Database: Conference paper
Related URLs:
Identification Number:
Last Modified:11 Mar 2020 10:27
Deposited On:11 Mar 2020 10:27

Repository Staff Only: item control page