EU Regional School - Hoefler Seminar
Prof. Dr. Torsten Hoefler - MPI Remote Memory Access Programming and Scientific Benchmarking of Parallel Codes
We will provide an overview of advanced MPI programming techniques. Specifically, we will focus on MPI-3's new Remote Memory Access (RMA) programming and an implementation thereof. We will discuss how to utilize MPI-3 RMA in modern applications. Furthermore, we will discuss issues in large-scale implementation and deployment. The lecture will then continue to a small number of other advanced MPI usage scenarios that every scientific computing researcher should know. Finally, we will discuss how to benchmark parallel applications in a scientifically rigorous way. This turns out to be surprisingly difficult and the state of the art is suboptimal. We will present twelve simple rules that can be used as guidelines for good scientific practice when it comes to measuring and reporting performance results.