Performance Analysis of Parallel Applications for HPC

Performance Analysis of Parallel Applications for HPC
Author: Jidong Zhai
Publisher: Springer Nature
Total Pages: 259
Release: 2023-09-09
Genre: Computers
ISBN: 9819943663

Download Performance Analysis of Parallel Applications for HPC Book in PDF, Epub and Kindle

This book presents a hybrid static-dynamic approach for efficient performance analysis of parallel applications on HPC systems. Performance analysis is essential to finding performance bottlenecks and understanding the performance behaviors of parallel applications on HPC systems. However, current performance analysis techniques usually incur significant overhead. Our book introduces a series of approaches for lightweight performance analysis. We combine static and dynamic analysis to reduce the overhead of performance analysis. Based on this hybrid static-dynamic approach, we then propose several innovative techniques for various performance analysis scenarios, including communication analysis, memory analysis, noise analysis, computation analysis, and scalability analysis. Through these specific performance analysis techniques, we convey to readers the idea of using static analysis to support dynamic analysis. To gain the most from the book, readers should have a basic grasp of parallel computing, computer architecture, and compilation techniques.

Sustained Simulation Performance 2019 and 2020

Sustained Simulation Performance 2019 and 2020
Author: Michael M. Resch
Publisher: Springer Nature
Total Pages: 187
Release: 2021-03-01
Genre: Computers
ISBN: 3030680495

Download Sustained Simulation Performance 2019 and 2020 Book in PDF, Epub and Kindle

This book presents the state of the art in High Performance Computing on modern supercomputer architectures. It addresses trends in hardware and software development in general. The contributions cover a broad range of topics, from performance evaluations in context with power efficiency to Computational Fluid Dynamics and High Performance Data Analytics. In addition, they explore new topics like the use of High Performance Computers in the field of Artificial Intelligence and Machine Learning. All contributions are based on selected papers presented at the 30th Workshop on Sustained Simulation Performance (WSSP) held at the High Performance Computing Center, University of Stuttgart, Germany in October 2019 and on the papers for the planned Workshop on Sustained Simulation Performance in March 2020, which could not take place due to the Covid-19 pandemic.

Communication in Parallel Applications

Communication in Parallel Applications
Author: Dale Seed
Publisher:
Total Pages: 21
Release: 1996
Genre: Data transmission systems
ISBN:

Download Communication in Parallel Applications Book in PDF, Epub and Kindle

Abstract: "Communication characterization of parallel applications is essential to understand the interplay between architectures and applications in determining the maximum achievable performance. Although a significant amount of research has been conducted on execution- based architectural evaluations, very little effort has gone into capturing the communication behavior of an application mathematically. In this paper, we attempt to characterize the communication behavior of applications by temporal, spatial and volume attributes. We also study the impact of variation in application and architectural parameters on the communication behavior in terms of the three attributes. Using a suite of five shared memory applications and an execution-driven simulator, called SPASM, this study generates and analyzes the communication events in these applications on a 2D-mesh network using wormhole switching and deterministic routing. The network activities are logged and fed to a statistical analysis package called SAS to quantify the distribution functions for both the message inter-arrival time and spatial distribution. The impact of varying the number of processors, the application problem size, the network bandwidth and the memory consistency model on the distribution functions are studied. The results show that for the chosen suite of applications, the message arrival and message destination distributions can be closely approximated by known statistical distributions and that the temporal as well as spatial distributions of all applications remain unchanged with respect to the variations in the four parameters considered. These results lead us closer to the belief that it is possible to abstract the communication properties of parallel applications in convenient mathematical forms that have wide applicability."

Supercomputing

Supercomputing
Author: Vladimir Voevodin
Publisher: Springer Nature
Total Pages: 713
Release: 2022-12-15
Genre: Computers
ISBN: 303122941X

Download Supercomputing Book in PDF, Epub and Kindle

This book constitutes the refereed proceedings of the 8th Russian Supercomputing Days on Supercomputing, RuSCDays 2022, which took place in Moscow, Russia, in September 2022. The 49 full papers and 1 short paper presented in this volume were carefully reviewed and selected from 94 submissions. The papers are organized in the following topical sections: Supercomputer Simulation; HPC, BigData, AI: Architectures, Technologies, Tools; Distributed and Cloud Computing.

Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures

Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures
Author: Sonja Holl
Publisher: Forschungszentrum Jülich
Total Pages: 207
Release: 2014
Genre:
ISBN: 389336949X

Download Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures Book in PDF, Epub and Kindle

Scientific workflows have emerged as a key technology that assists scientists with the design, management, execution, sharing and reuse of in silico experiments. Workflow management systems simplify the management of scientific workflows by providing graphical interfaces for their development, monitoring and analysis. Nowadays, e-Science combines such workflow management systems with large-scale data and computing resources into complex research infrastructures. For instance, e-Science allows the conveyance of best practice research in collaborations by providing workflow repositories, which facilitate the sharing and reuse of scientific workflows. However, scientists are still faced with different limitations while reusing workflows. One of the most common challenges they meet is the need to select appropriate applications and their individual execution parameters. If scientists do not want to rely on default or experience-based parameters, the best-effort option is to test different workflow set-ups using either trial and error approaches or parameter sweeps. Both methods may be inefficient or time consuming respectively, especially when tuning a large number of parameters. Therefore, scientists require an effective and efficient mechanism that automatically tests different workflow set-ups in an intelligent way and will help them to improve their scientific results. This thesis addresses the limitation described above by defining and implementing an approach for the optimization of scientific workflows. In the course of this work, scientists’ needs are investigated and requirements are formulated resulting in an appropriate optimization concept. In a following step, this concept is prototypically implemented by extending a workflow management system with an optimization framework, including general mechanisms required to conduct workflow optimization. As optimization is an ongoing research topic, different algorithms are provided by pluggable extensions (plugins) that can be loosely coupled with the framework, resulting in a generic and quickly extendable system. In this thesis, an exemplary plugin is introduced which applies a Genetic Algorithm for parameter optimization. In order to accelerate and therefore make workflow optimization feasible at all, e-Science infrastructures are utilized for the parallel execution of scientific workflows. This is empowered by additional extensions enabling the execution of applications and workflows on distributed computing resources. The actual implementation and therewith the general approach of workflow optimization is experimentally verified by four use cases in the life science domain. All workflows were significantly improved, which demonstrates the advantage of the proposed workflow optimization. Finally, a new collaboration-based approach is introduced that harnesses optimization provenance to make optimization faster and more robust in the future.

Euro-Par 2005 Parallel Processing

Euro-Par 2005 Parallel Processing
Author: José C. Cunha
Publisher: Springer
Total Pages: 1311
Release: 2005-08-25
Genre: Computers
ISBN: 3540319255

Download Euro-Par 2005 Parallel Processing Book in PDF, Epub and Kindle

Euro-Par 2005 was the eleventh conference in the Euro-Par series. It was organized by the Centre for Informatics and Information Technology (CITI) and the Department of Informatics of the Faculty of Science and Technology of Universidade Nova de Lisboa, at the Campus of Monte de Caparica.

Applied Parallel Computing. New Paradigms for HPC in Industry and Academia

Applied Parallel Computing. New Paradigms for HPC in Industry and Academia
Author: Tor Sorevik
Publisher: Springer
Total Pages: 411
Release: 2003-06-29
Genre: Computers
ISBN: 3540707344

Download Applied Parallel Computing. New Paradigms for HPC in Industry and Academia Book in PDF, Epub and Kindle

The papers in this volume were presented at PARA 2000, the Fifth International Workshop on Applied Parallel Computing. PARA 2000 was held in Bergen, Norway, June 18-21, 2000. The workshop was organized by Parallab and the Department of Informatics at the University of Bergen. The general theme for PARA 2000 was New paradigms for HPC in industry and academia focusing on: { High-performance computing applications in academia and industry, { The use of Java in high-performance computing, { Grid and Meta computing, { Directions in high-performance computing and networking, { Education in Computational Science. The workshop included 9 invited presentations and 39 contributed pres- tations. The PARA 2000 meeting began with a one-day tutorial on OpenMP programming led by Timothy Mattson. This was followed by a three-day wor- hop. The rst three PARA workshops were held at the Technical University of Denmark (DTU), Lyngby (1994, 1995, and 1996). Following PARA’96, an - ternational steering committee for the PARA meetings was appointed and the committee decided that a workshop should take place every second year in one of the Nordic countries. The 1998 workshop was held at Ume a University, Sweden. One important aim of these workshops is to strengthen the ties between HPC centers, academia, and industry in the Nordic countries as well as worldwide. The University of Bergen organized the 2000 workshop and the next workshop in the year 2002 will take place at the Helsinki University of Technology, Espoo, Finland.