Title

Bridging The Gap Between Parallel File Systems And Local File Systems: A Case Study With Pvfs

Abstract

Parallel I/O plays an increasingly important wie in today's data intensive computing applications. While much attention has been paid to parallel read performance, most of this work has focused on the parallel file system, middleware, or application layers, ignoring the potential for improvement through more effective use of local storage. In this paper, we present the design and implementation of Segment-structured On-disk data Grouping and Prefetching (SOGP), a technique that leverages additional local storage to boost the local data read performance for parallel file systems, especially for those applications with partially overlapped access patterns. Parallel Virtual File System (PVFS) is chosen as an example. Our experiments show that an SOGP-enhancedPVFS prototype system can outperform a traditional Linux-Ext-based PVFS for many applications and benchmarks, in some tests by as much as 230% in terms of I/O bandwidth. © 2008 IEEE.

Publication Date

11-17-2008

Publication Title

Proceedings of the International Conference on Parallel Processing

Number of Pages

554-561

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/ICPP.2008.43

Socpus ID

55849121226 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/55849121226

This document is currently not available here.

Share

COinS