Enhancing the performance of malleable MPI applications by using performance-aware dynamic reconfiguration

Gonzalo Martín, David E. Singh, Maria Cristina Marinescu, Jesús Carretero

Research output: Indexed journal article Articlepeer-review

33 Citations (Scopus)

Abstract

Abstract The work in this paper focuses on providing malleability to MPI applications by using a novel performance-aware dynamic reconfiguration technique. This paper describes the design and implementation of Flex-MPI, an MPI library extension which can automatically monitor and predict the performance of applications, balance and redistribute the workload, and reconfigure the application at runtime by changing the number of processes. Unlike existent approaches, our reconfiguring policy is guided by user-defined performance criteria. We focus on iterative SPMD programs, a class of applications with critical mass within the scientific community. Extensive experiments show that Flex-MPI can improve the performance, parallel efficiency, and cost-efficiency of MPI programs with a minimal effort from the programmer.

Original languageEnglish
Article number2250
Pages (from-to)60-77
Number of pages18
JournalParallel Computing
Volume46
DOIs
Publication statusPublished - 16 Jun 2015
Externally publishedYes

Keywords

  • Computational prediction model
  • Distributed systems
  • High performance computing
  • Malleable MPI applications
  • Performance-aware dynamic Reconfiguration

Fingerprint

Dive into the research topics of 'Enhancing the performance of malleable MPI applications by using performance-aware dynamic reconfiguration'. Together they form a unique fingerprint.

Cite this