Title

Reduced Function Set Abstraction (Rfsa) For Mpi-Io

Keywords

MPI-IO; Parallel programmer productivity

Abstract

Programmers productivity has always been overlooked as compared to the performance optimizations in high performance computing (HPC) community. In many parallel programming languages like MPI/MPI-IO, the performance optimizations are provided as various function options to the programmers. In order to write an efficient code, they are required to know the exact usage of the optimization functions, hence programmer productivity is limited. In this paper, we present RFSA, a Reduced Function Set Abstraction based on an existing parallel programming interface (MPI-IO) for I/O. The purpose of RFSA is to hide the performance optimization functions from the application developer, and relieve the application developer from deciding on a specific function. The proposed set of functions rely on a selection algorithm to decide among the most common optimizations provided by MPI-IO. We implement a selection algorithm for I/O functions like read, write, etc., and also merge a set of functions for data types and file views. By running different parallel I/O benchmarks on both medium-scale clusters and NERSC supercomputers, we show an improved programmer productivity (35.7% on average). This approach incurs an overhead of 2-5% for one particular optimization, and shows performance improvement of 17% when a combination of different optimizations is required by an application. © 2010 Springer Science + Business Media, Inc.

Publication Date

1-1-2012

Publication Title

Journal of Supercomputing

Volume

59

Issue

1

Number of Pages

131-146

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1007/s11227-010-0429-8

Socpus ID

84897577389 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84897577389

This document is currently not available here.

Share

COinS