awesome-high-performance-computing
A curated list of awesome high performance computing resources
https://github.com/trevor-vincent/awesome-high-performance-computing
Last synced: 12 days ago
JSON representation
-
General Info
-
A Few Upcoming Supercomputers
- El Capitan - 2023, AMD-based, ~1.5 exaflops
- Tianhe-3 - 2022, ~700 Petaflop (Linpack500)
- Venado - 2024, Grace-Hopper based ~10 exaflops
-
History
-
Most Recent List of the Top500 Supercomputers
- Top500 (Nov. 2023)
- Green500 (Nov. 2023)
- io500
- Top500 (June 2024)
- HPCG Top500 (June 2024)
- Green500 (June 2024)
- Top500 (Nov. 2024)
- HPCG Top500 (Nov. 2024)
- Green500 (Nov. 2024)
- Top500 (June 2025)
- HPCG Top500 (June 2025)
- Green500 (June 2025)
- Top500 (Nov. 2025)
- HPCG Top500 (Nov. 2025)
- Green500 (Nov. 2025)
- Top500 (Jun. 2026)
- HPCG Top500 (Jun. 2026)
- Green500 (Jun. 2026)
-
Trends
-
-
Hardware
-
Certification
-
Cloud
- AWS HPC
- Azure HPC
- rescale
- vast.ai
- hetzner - cheap servers incl. 80-core ARM
- Ampere ARM cloud-native processors
- Scaleway
- Chameleon Cloud
- Runpod
- The use of Microsoft Azure for high performance cloud computing – A case study
- AWS Cluster in the cloud
- AWS Parallel Cluster
- An Empirical Study of Containerized MPI and GUI Application on HPC in the Cloud
- Awesome Cloud HPC
- Official NVIDIA Vendors
- Azure HPC
- AWS HPC Workshop
- Unlocking Python’s Cores: Hardware Usage and Energy Implications of Removing the GIL
- NVIDIA Brev
-
CPU
-
Custom/FPGA/ASIC/APU
-
GPU
- Gpu Architecture Analysis
- A trip through the Graphics Pipeline
- A100 Whitepaper
- MIG
- Gentle Intro to GPU Inner Workings
- AMD Instinct GPUs
- AMD GPU ROCm Support and OS Compatibility
- List of AMD GPUs
- Tales of the M1 GPU
- List of Intel GPUs
- Performance of DGX Cluster
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels
- Cuda Ontology
-
Interconnects/Topology
-
Many integrated core processor (MIC)
-
Other/Wikis
-
Student Opportunities / Workshops
-
TPU/Tensor Cores
-
Vendors (Work in Progress)
-
-
Other Curated Lists
-
People
-
Other/Wikis
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Bill Gropp - 2010 IEEE TCSC Medal for Excellence in Scalable Computing
- David Bader - built the first Linux supercomputer
- Thomas Sterling - Inventor of Beowulf cluster, ParalleX/HPX
- Seymour Cray - Inventor of the Cray Supercomputer
- Larry Smarr - HPC Application Pioneer
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Donald Becker - Beowulf cluster software, Gordon Bell Prize Winner
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- HPCWire Class of 2025
- HPCWire Class of 2024
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
- Jack Dongarra - 2021 Turing Award - LINPACK, BLAS, LAPACK, MPI
-
-
Resources
-
Other/Wikis
- Infiniband Essentials
- Microarchitecture of Intel/AMD CPUs
- Computer cluster
- Free Modern HPC Books by Victor Eijkhout
- High Performance Parallel Runtimes
- The OpenMP Common Core: Making OpenMP Simple Again
- Parallel and High Performance Computing
- Algorithms for Modern Hardware
- High Performance Computing: Modern Systems and Practices - Thomas Sterling, Maciej Brodowicz, Matthew Anderson 2017
- Introduction to High Performance Computing for Scientists and Engineers - Hager 2010
- Computer Organization and Design
- Introduction to High Performance Scientific Computing - Victor Eijkhout 2021
- Parallel Programming for Science and Engineering - Victor EIjkhout 2021
- Parallel Programming for Science and Engineering - HTML Version
- C++ High Performance
- Data Parallel C++ Mastering DPC++ for Programming of Heterogeneous Systems using C++ and SYCL
- High Performance Python
- C++ Concurrency in Action: Practical Multithreading - Anthony Williams 2012
- The Art of Multiprocessor Programming - Maurice Herlihy 2012
- Parallel Computing: Theory and Practice - Umut A. Acar 2016
- Introduction to Parallel Computing - Zbigniew J. Czech
- Optimizing software in C++
- Optimizing subroutines in assembly code
- Parallel Programming with MPI
- HPC, Big Data, AI Convergence Towards Exascale: Challenge and Vision
- Introduction to parallel computing - Ananth Grama
- The Student Supercomputer Challenge Guide
- The Rust Performance Book
- E-Zines on Bash, Linux, Perf, etc - Julia Evans
- The Art of Writing Efficient Programs: An Advanced Programmer's Guide to Efficient Hardware Utilization and Compiler Optimizations Using C++ Examples
- OpenMP Examples - openmp.org
- Latest books on OpemMP - openmp.org
- Programming Massively Parallel Processors 4th Edition 2023
- Software Optimization Cookbook
- Power and Performance_ Software Analysis and Optimization
- Gropp books on MPI
- Performance Analysis and Tuning on Modern CPUs
- HPC Carpentry
- Berkeley: Applications of Parallel Computers - Detailed course on HPC
-
Programming Languages
Sub Categories
Other/Wikis
609
Trends
247
Cloud
19
Most Recent List of the Top500 Supercomputers
18
GPU
13
Interconnects/Topology
11
CPU
10
History
6
Vendors (Work in Progress)
5
Student Opportunities / Workshops
4
Custom/FPGA/ASIC/APU
4
A Few Upcoming Supercomputers
3
TPU/Tensor Cores
2
Many integrated core processor (MIC)
1
Certification
1
Keywords
hpc
16
gpu
9
python
9
mpi
7
parallel-computing
7
parallel-programming
7
cuda
7
linux
7
cpp
7
c-plus-plus
7
gpu-programming
6
machine-learning
6
rust
5
profiling
5
c
4
benchmarking
4
parallel
4
high-performance-computing
4
heterogeneous-parallel-programming
4
deep-learning
4
benchmark
4
intel
3
openmp
3
hip
3
data-science
3
compiler
3
performance-analysis
3
performance
3
cli
3
pytorch
3
slurm
3
distributed-computing
3
profiler
3
scientific-computing
3
gpu-computing
3
disk
2
simd
2
macos
2
radiuss
2
shmem
2
jit
2
instrumentation
2
header-only
2
awesome-list
2
awesome
2
heterogeneous-computing
2
terminal
2
pgas
2
nvidia-gpu
2
command-line
2