Automated Scheduling Algorithm Selection and Chunk Parameter Calculation in OpenMP

Mohammed, Ali and Müller Korndörfer, Jonas H. and Eleliemy, Ahmed and Ciorba M., Florina. (2022) Automated Scheduling Algorithm Selection and Chunk Parameter Calculation in OpenMP. IEEE Transactions on Parallel and Distributed Systems (TPDS), 33 (12). pp. 4383-4394.

[img] PDF - Published Version
Available under License CC BY (Attribution).


Official URL: https://edoc.unibas.ch/92783/

Downloads: Statistics Overview


Increasing node and cores-per-node counts in supercomputers render scheduling and load balancing critical for exploiting parallelism. OpenMP applications can achieve high performance via careful selection of scheduling kind and chunk parameters on a per-loop, per-application, and per-system basis from a portfolio of advanced scheduling algorithms (Korndörfer et al. , 2022). This selection approach is time-consuming, challenging, and may need to change during execution. We propose Auto4OMP , a novel approach for automated load balancing of OpenMP applications. With Auto4OMP, we introduce three scheduling algorithm selection methods and an expert-defined chunk parameter for OpenMP's schedule clause's kind and chunk , respectively. Auto4OMP extends the OpenMP schedule(auto) and chunk parameter implementation in LLVM's OpenMP runtime library to automatically select a scheduling algorithm and calculate a chunk parameter during execution. Loop characteristics are inferred in Auto4OMP from the loop execution over the application's time-steps. The experiments performed in this work show that Auto4OMP improves applications performance by up to 11 % compared to LLVM's schedule(auto) implementation and outperforms manual selection. Auto4OMP improves MPI+OpenMP applications performance by explicitly minimizing thread- and implicitly reducing process-load imbalance.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Informatik > High Performance Computing (Ciorba)
UniBasel Contributors:Ciorba, Florina M. and Mohammed, Ali Omar Abdelazim and Muller Korndorfer, Jonas Henrique and Eleliemy, Ahmed Hamdy Mohamed
Item Type:Article, refereed
Article Subtype:Research Article
Publisher:Institute of Electrical and Electronics Engineers
Note:Publication type according to Uni Basel Research Database: Journal article
Related URLs:
Identification Number:
edoc DOI:
Last Modified:19 Jan 2023 14:15
Deposited On:19 Jan 2023 14:15

Repository Staff Only: item control page