Title
Tools For Enabling Automatic Validation Of Large-Scale Parallel Application Simulations
Keywords
Fine-grained Metrics; Performance Evaluation; Simulation Validation
Abstract
Validation is highly important in parallel application simulations with a large number of parameters, a process that can vary depending on the structure of the simulator and the granularity of the models used. Common practice involves calculating the percentage error between the projected and the real execution time of a benchmark program. However, this coarse-grained approach often suffers from a parameter insensitivity problem in regions of high-dimensional parameter space. In this work we demonstrate the use of our fine-grained validation toolset to capture and compare the statistical characteristics of a parallel application's execution. It is the first toolset to apply fine-grained statistics to large-scale simulation validation, and our experimental evaluation shows that it offers a significant improvement in fidelity when compared to validation using total execution time.
Publication Date
12-4-2014
Publication Title
Proceedings - 30th International Conference on Software Maintenance and Evolution, ICSME 2014
Number of Pages
601-604
Document Type
Article; Proceedings Paper
Personal Identifier
scopus
DOI Link
https://doi.org/10.1109/ICSME.2014.105
Copyright Status
Unknown
Socpus ID
84931024630 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/84931024630
STARS Citation
Zhang, Deli; Hendry, Gilbert; and Dechev, Damian, "Tools For Enabling Automatic Validation Of Large-Scale Parallel Application Simulations" (2014). Scopus Export 2010-2014. 8365.
https://stars.library.ucf.edu/scopus2010/8365