
Foundations of High-Performance Computing
A Comprehensive Guide to Systems, Concepts, and Programming
- 1st Edition - April 1, 2026
- Latest edition
- Author: Oscar Diez
- Language: English
Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming serves as an essential and up-to-date introduction on the world of high-p… Read more

Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming serves as an essential and up-to-date introduction on the world of high-performance computing (HPC). Geared toward graduate students, early-career professionals, and researchers, this volume lays the groundwork for advanced study by thoroughly exploring the core systems, foundational concepts, and introductory programming skills vital to the HPC field. The book’s five-part structure begins with the evolution and architectural overview of HPC, then moves into basic programming principles, resource management, and performance metrics, equipping readers with practical knowledge for accessing and utilizing HPC systems.
Beyond the basics, the guide delves into parallel computing through OpenMP, MPI, GPU computing, OpenACC, and CUDA, offering a multidisciplinary approach to multithreading and distributed memory. It further explores parallel I/O, data management, modern filesystems, cloud-based HPC solutions, and virtualization, ensuring readers grasp the latest trends and technologies. Concluding with a reference section and glossary, this book stands as a comprehensive resource for building a robust foundation in high-performance computing.
Beyond the basics, the guide delves into parallel computing through OpenMP, MPI, GPU computing, OpenACC, and CUDA, offering a multidisciplinary approach to multithreading and distributed memory. It further explores parallel I/O, data management, modern filesystems, cloud-based HPC solutions, and virtualization, ensuring readers grasp the latest trends and technologies. Concluding with a reference section and glossary, this book stands as a comprehensive resource for building a robust foundation in high-performance computing.
- Offers comprehensive coverage of modern high performance computing topics, including hybrid cloud HPC, quantum computing, and GPU optimization
- Focuses on infrastructure, programming basics, and practical access to HPC systems
- Provides hands-on examples, exercises, and access to code repositories to solidify practical understanding
- Sits alongside its companion book, High-Performance Computing: Applications and Frontiers, to develop the reader's understanding and skills from introduction to advance level
graduate students and undergraduates in computer science and engineering disciplines. Researchers in academia and industry focusing on high performance computing applications, optimization, and next-generation computing technologies
Part One: Introduction to High Performance Computing
1. Introduction
2. Evolution and Fundamentals of High Performance Computing
3. Architectural Overview of HPC Systems
Part Two: High Performance Computing Programming Basics
4. Resource Management and Performance Metrics in Parallel Systems
5. Practical Access to High Performance Computing
6. Distributed and Shared Memory Concepts
Part Three: Foundations of Parallel Programming
7. OpenMP for Multithreading
8. Deep Dive into MPI Programming
9. Introduction to GPU Computing, OpenACC, and CUDA Basics
Part Four: Practical High Performance Computing Infrastructure
10. Parallel I/O, Data Management and Filesystems
11. Cloud-Based High Performance Computing and Virtualization
Part Five: Conclusion and Reference Material
12. Glossary
13. References
1. Introduction
2. Evolution and Fundamentals of High Performance Computing
3. Architectural Overview of HPC Systems
Part Two: High Performance Computing Programming Basics
4. Resource Management and Performance Metrics in Parallel Systems
5. Practical Access to High Performance Computing
6. Distributed and Shared Memory Concepts
Part Three: Foundations of Parallel Programming
7. OpenMP for Multithreading
8. Deep Dive into MPI Programming
9. Introduction to GPU Computing, OpenACC, and CUDA Basics
Part Four: Practical High Performance Computing Infrastructure
10. Parallel I/O, Data Management and Filesystems
11. Cloud-Based High Performance Computing and Virtualization
Part Five: Conclusion and Reference Material
12. Glossary
13. References
- Edition: 1
- Latest edition
- Published: April 1, 2026
- Language: English
OD
Oscar Diez
Oscar Diez has a dual role as a professor and researcher, combining academic expertise in teaching HPC courses at IE University with applied research experience at the European Commission. With over a decade of experience, he has guided students and professionals through complex computational systems, emphasizing both theory and real-world applications.
Affiliations and expertise
IE University, Madrid, Spain