Algorithmic patterns for H-matrices on many-core processors

Zaspel, Peter Eberhard. (2017) Algorithmic patterns for H-matrices on many-core processors. Preprints Fachbereich Mathematik, 2017 (12).

[img] PDF - Published Version

Official URL: https://edoc.unibas.ch/69935/

Downloads: Statistics Overview


In this work, we consider the reformulation of hierarchical ($\mathcal{H}$) matrix algorithms for many-core processors with a model implementation on graphics processing units (GPUs). $\mathcal{H}$ matrices approximate specific dense matrices, e.g., from discretized integral equations or kernel ridge regression, leading to log-linear time complexity in dense matrix-vector products. The parallelization of $\mathcal{H}$ matrix operations on many-core processors is difficult due to the complex nature of the underlying algorithms. While previous algorithmic advances for many-core hardware focused on accelerating existing $\mathcal{H}$ matrix CPU implementations by many-core processors, we here aim at totally relying on that processor type. As main contribution, we introduce the necessary parallel algorithmic patterns allowing to map the full $\mathcal{H}$ matrix construction and the fast matrix-vector product to many-core hardware. Here, crucial ingredients are space filling curves, parallel tree traversal and batching of linear algebra operations. The resulting model GPU implementation hmglib is the, to the best of the authors knowledge, first entirely GPU-based Open Source $\mathcal{H}$ matrix library of this kind. We conclude this work by an in-depth performance analysis and a comparative performance study against a standard $\mathcal{H}$ matrix library, highlighting profound speed ups of our many-core parallel approach.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Mathematik > Computational Mathematics (Harbrecht)
12 Special Collections > Preprints Fachbereich Mathematik
UniBasel Contributors:Zaspel, Peter
Item Type:Preprint
Publisher:Universität Basel
edoc DOI:
Last Modified:20 Apr 2019 15:32
Deposited On:28 Mar 2019 09:51

Repository Staff Only: item control page