Title

The Impact Of Negative Acknowledgments In Shared Memory Scientific Applications

Keywords

Cache coherence protocol; Distributed shared memory; Negative acknowledgment; Node controller occupancy

Abstract

Negative ACKnowledgments (NACKs) and subsequent retries, used to resolve races and to enforce a total order among shared memory accesses in distributed shared memory (DSM) multiprocessors, not only introduce extra network traffic and contention, but also increase node controller occupancy, especially at the home. In this paper, we present possible protocol optimizations to minimize these retries and offer a thorough study of the performance effects of these messages on six scalable scientific applications running on 64-node systems and larger. To eliminate NACKs, we present a mechanism to queue pending requests at the main memory of the home node and augment it with a novel technique of combining pending read requests, thereby accelerating the parallel execution for 64 nodes by as much as 41 percent (a speedup of 1.41) compared to a modified version of the SGI Origin 2000 protocol. We further design and evaluate a protocol by combining this mechanism with a technique that we call write string forwarding, used in the AlphaServer GS320 and Piranha systems. We find that without careful design considerations, especially regarding atomic read-modify-write operations, this aggressive write forwarding can hurt performance. We identify and evaluate the necessary micro-architectural support to solve this problem. We compare the performance of these novel NACK-free protocols with a base bitvector protocol, a modified version of the SGI Origin 2000 protocol, and a NACK-free protocol that uses dirty sharing and write string forwarding as in the Piranha system. To understand the effects of network speed and topology the evaluation is carried out on three network configurations.

Publication Date

2-1-2004

Publication Title

IEEE Transactions on Parallel and Distributed Systems

Volume

15

Issue

2

Number of Pages

134-150

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/TPDS.2004.1264797

Socpus ID

1342308831 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/1342308831

This document is currently not available here.

Share

COinS