Title
Conflict Detection Algorithm To Minimize Locking For Mpi-Io Atomicity
Abstract
Many scientific applications require high-performance concurrent I/O accesses to a file by multiple processes. Those applications rely indirectly on atomic I/O capabilities in order to perform updates to structured datasets, such as those stored in HDF5 format files. Current support for atomicity in MPI-IO is provided by locking around the operations, imposing lock overhead in all situations, even though in many cases these operations are non-overlapping in the file. We propose to isolate non-overlapping accesses from overlapping ones in independent I/O cases, allowing the non-overlapping ones to proceed without imposing lock overhead. To enable this, we have implemented an efficient conflict detection algorithm in MPI-IO using MPI file views and datatypes. We show that our conflict detection scheme incurs minimal overhead on I/O operations, making it an effective mechanism for avoiding locks when they are not needed. © 2009 Springer Berlin Heidelberg.
Publication Date
1-1-2009
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume
5759 LNCS
Number of Pages
143-153
Document Type
Article; Proceedings Paper
Personal Identifier
scopus
DOI Link
https://doi.org/10.1007/978-3-642-03770-2_21
Copyright Status
Unknown
Socpus ID
70350776217 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/70350776217
STARS Citation
Sehrish, Saba; Wang, Jun; and Thakur, Rajeev, "Conflict Detection Algorithm To Minimize Locking For Mpi-Io Atomicity" (2009). Scopus Export 2000s. 12721.
https://stars.library.ucf.edu/scopus2000/12721