Presentation
Using the SPEC HPG Benchmarks for Better Analysis and Evaluation of Current and Future HPC Systems
Event Type
Tutorial
Compilers
Computer Architecture
HPC Accelerators
Heterogeneous Systems
Performance Analysis and Optimization
TimeSunday, June 24th2pm - 6pm
LocationExpose
DescriptionThe High Performance Group (HPG) of the Standard Performance Evaluation Corporation (SPEC) develops benchmark methodologies for High Performance Computing systems. The group also releases production quality benchmark suites like SPEC MPI2007, SPEC OMP2012, and SPEC ACCEL, that can evaluate all dimensions of parallelism. These benchmarks are used in academia and industry to conduct research in HPC systems, facilitate procurement, testing, and tuning of HPC systems. In order to make these benchmarks more available, SPEC HPG offers these benchmark suites free of charge to non-commercial users. In this half-day tutorial, participants will learn how to leverage SPEC benchmarks for performance evaluation, tuning of system parameters, comparison of systems (e.g., for procurement), and get an outlook on its power measurement capabilities. The presenters will provide demos and hands-on guidance on how to install, compile, and run the benchmarks on HPC systems provided. The presenters will also show how the results will be interpreted, discuss various use cases, and present the publication process of results. An SSH-capable device is required for the hands-on sessions.
Content Level 40% beginner, 60% intermediate
Target Audience The tutorial is targeted at technical and research staff, application developers and academic users studying performance aspects of applications and measuring performance relevant properties of HPC systems. This tutorial is also appropriate for people responsible for and reporting on acceptance tests of compute clusters.
PrerequisitesThe tutorial targets attendees with basic understanding of common computer architectures for the interpretation of SPEC benchmarks results. Furthermore, familiarity with basic concepts of parallel programming is helpful. No prior knowledge on benchmarks is needed. For the hands-on sessions, participants should bring an SSH-capable laptop with wired or wireless network capability. Correspondingly, having a wired and wireless internet connection in the tutorial room is necessary.
Authors
Research Assistant
Head of Computational Science Group
Principal System Analyst
HPC User Support Specialist/Programmer