awesome-high-performance-computing

A curated list of awesome high performance computing resources
https://github.com/trevor-vincent/awesome-high-performance-computing

Last synced: about 17 hours ago
JSON representation

People
- Other/Wikis
Software
- Trends
  - alpaka - The alpaka library is a header-only C++17 abstraction library for accelerator development
  - async-rdma - A framework for writing RDMA applications with high-level abstraction and asynchronous APIs
  - CAF - An Open Source Implementation of the Actor Model in C++
  - Codon - high-performance Python compiler that compiles Python code to native machine code without any runtime overhead
  - FastFlow - High-performance Parallel Patterns in C++
  - Galois - A C++ Library to Ease Parallel Programming with Irregular Parallelism
  - Heteroflow - Concurrent CPU-GPU Task Programming using Modern C++
  - highway - Performance portable SIMD intrinsics
  - HPX - A C++ Standard Library for Concurrency and Parallelism
  - Horovod - Distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet
  - Intel ISPC - SPMD compiler
  - Kompute - The general purpose GPU compute framework for cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends)
  - Kokkos - A C++ Programming Model for Writing Performance Portable Applications on HPC platforms
  - Kubeflow MPI Operator - MPI Operator for Kubeflow
  - Legion - Distributed heterogeneous programming library
  - MOGSLib - User defined schedulers
  - mpi4jax - Zero-copy mpi for jax arrays
  - Pollux - Message Passing Cloud orchestrator
  - Pyfi - Distributed flow and computation system
  - RAJA - Architecture and programming model portability for HPC applications
  - RaftLib - A C++ Library for Enabling Stream and Dataflow Parallel Computation
  - Scalix - Data parallel computing framework
  - Taichi - Parallel programming language for high-performance numerical computations in Python
  - Taskflow - A Modern C++ Parallel Task Programming Library
  - Transwarp - A Header-only C++ Library for Task Concurrency
  - UCX - Optimized production proven-communication framework
  - Zluda - Run unmodified CUDA applications with near-native performance on Intel AMD GPUs.
  - HyperQueue - HyperQueue is a tool designed to simplify execution of large workflows (task graphs) on HPC clusters.
  - cpufetch - A simple yet fancy CPU architecture fetching tool.
  - gpufetch - A tool similar to cpufetch, but for fetching GPU architecture.
  - Likwid - Provides all information about the supercomputer/cluster.
  - PRK - Parallel Research Kernels - A collection of kernels for parallel programming research.
  - Bluebanquise - An open-source cluster management tool.
  - DeepOps - Nvidia's GPU infrastructure and automation tools for Kubernetes and Slurm clusters.
  - Ruse - A tool for managing software environments in HPC clusters.
  - sstack - A tool to install multiple software stacks such as Spack, EasyBuild, and Conda.
  - McKernel - A hybrid kernel that combines Linux and a lightweight kernel designed to provide high performance for HPC applications.
  - arbiter2 - Monitors and protects interactive nodes with cgroups.
  - Charliecloud - Lightweight container solution for high-performance computing (HPC).
  - genv - GPU Environment Management for managing and scheduling GPU resources.
  - Grafana - Open-source platform for monitoring and observability, visualizing metrics.
  - HPC Rocket - Allows submitting Slurm jobs in Continuous Integration (CI) pipelines.
  - perun - Energy monitor for HPC systems, focusing on performance and energy efficiency.
  - redun - Workflow engine that emphasizes simplicity, reliability, and scalability.
  - remora - Tool for monitoring and reporting the performance of batch jobs on HPC systems.
  - ruptime - A utility for monitoring the status of computational jobs and systems.
  - Slurmvision slurm dashboard - A dashboard for monitoring and managing Slurm jobs.
  - slurm docker cluster - A Slurm cluster implemented using Docker containers, for development and testing.
  - Stui slurm dashboard for the terminal - A terminal-based UI for managing and monitoring Slurm clusters.
  - Vaex - A Python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets.
  - seer modern gui for gdb - A graphical user interface for GDB, aiming to improve the debugging experience with modern features and visuals.
  - Geekbench - Cross platform benchmarking tool
  - Chapel - A Programming Language for Productive Parallel Computing on Large-scale Systems
  - Charm++ - Parallel Programming with Migratable Objects
  - Cilk Plus - C/C++ Extension for Data and Task Parallelism
  - CUDA - High performance NVIDIA GPU acceleration
  - DeterminedAI - Distributed deep learning
  - Halide - A language for fast, portable computation on images and tensors
  - HPC-X - Nvidia implementation of MPI
  - ISPC - An open-source compiler for high-performance SIMD programming on the CPU and GPU
  - joblib - Data-flow programming for performance (python)
  - MAGMA - Next generation linear algebra (LA) GPU accelerated libraries
  - Merlin - A distributed task queuing system, designed to allow complex HPC workflows to scale to large numbers of simulations
  - mpi4py - Python bindings for MPI
  - MPI - OpenMPI implementation of the Message passing interface
  - MPI - MPICH implementation of the Message passing interface
  - MPI Standardization Forum - Forum for MPI standardization
  - MPAVICH - Implementation of MPI
  - NCCL - The NVIDIA Collective Communication Library for multi-GPU and multi-node communication
  - cuNumeric - GPU drop-in for numpy
  - stdpar - GPU accelerated C++ from NVIDIA
  - numba - A JIT compiler that translates a subset of Python into fast machine code
  - oneAPI - A unified, multiarchitecture, multi-vendor programming model
  - OpenACC - "OpenMP for GPUs"
  - OpenCilk - MIT continuation of Cilk Plus
  - OpenMP - Multi-platform Shared-memory Parallel Programming in C/C++ and Fortran
  - PVM - Parallel Virtual Machine: A predecessor to MPI for distributed computing
  - PMIX - Standard for process management
  - ray - Scale AI and Python workloads from reinforcement learning to deep learning
  - ROCM - First open-source software development platform for HPC/Hyperscale-class GPU computing
  - RS MPI - Rust bindings for MPI
  - Simgrid - Simulate cluster/HPC environments
  - SkelCL - A Skeleton Library for Heterogeneous Systems
  - STAPL - Standard Template Adaptive Parallel Programming Library in C++
  - STLab - High-level Constructs for Implementing Multicore Algorithms with Minimized Contention
  - SYCL - C++ Abstraction layer for heterogeneous devices
  - The Open Community Runtime - Specification for Asynchronous Many Task systems
  - Tuplex - Blazing fast python data science
  - cpuid instruction note
  - openmpi hwloc
  - Flux framework - A framework for high-performance computing clusters.
  - E4S - The Extreme Scale HPC Scientific Stack - A collection of open-source software packages for HPC environments.
  - OpenHPC - A community-led set of HPC components.
  - Lustre Parallel File System - A high-performance distributed filesystem for large-scale cluster computing.
  - Spack - A package manager for HPC/supercomputers.
  - Easybuild - A package manager for HPC/supercomputers.
  - Lmod - A Lua-based module system for software environment management on HPC systems.
  - LSF - A batch system for HPC and distributed computing environments.
  - moosefs - A fault-tolerant, highly available, distributed file system.
  - OpenOnDemand - A web portal for accessing supercomputing resources.
  - mOS - A specialized operating system for high-performance computing, designed to support large-scale, manycore processors.
  - Kitten - A lightweight kernel designed for high-performance computing. It focuses on providing low noise and predictable performance for HPC applications.
  - Apptainer (formerly Singularity) - Container platform designed for scientific and high-performance computing (HPC) environments.
  - Docker - A set of platform as a service products that use OS-level virtualization to deliver software in packages called containers.
  - HTCondor - An open-source high-throughput computing software framework.
  - grpc - A high-performance, open-source universal RPC framework.
  - Apache Airflow - A platform to programmatically author, schedule, and monitor workflows.
  - the yt project - An open-source, Python-based package for analyzing and visualizing volumetric data.
  - Summary of C/C++ debugging tools
  - ddt
  - totalview - A comprehensive source code analysis and debugging tool designed for complex software running on HPC systems, supporting a wide range of languages and architectures.
  - marmot MPI checker - A tool for detecting and reporting issues in MPI (Message Passing Interface) applications.
  - python debugging tools - A collection of tools for debugging Python applications, including pdb and other utilities.
  - Summary of profiling tools - A comprehensive list of profiling tools for performance analysis in HPC.
  - Summary of code performance analysis tools
  - vampir - A tool for detailed analysis of MPI program executions by visualizing their event traces.
  - Flamegraphs - Visualization tool for profiling software, allowing quick identification of performance bottlenecks.
  - fio - Flexible I/O tester for benchmarking and stress/hardware verification.
  - SPEC CPU Benchmark - A benchmark suite designed to provide a comparative measure of compute-intensive performance across the widest practical range of hardware.
  - STREAM Memory Bandwidth Benchmark - Measures sustainable memory bandwidth and the corresponding computation rate for simple vector kernels.
  - Intel MPI benchmarks - A set of benchmarks designed to measure the performance and scalability of MPI implementations on Intel architectures.
  - tnl project
  - visit
  - petsc
  - ginkgo
  - GSL
  - Scalapack
  - trilinos
  - Software utilization at UK National Supercomputing Service, ARCHER2
  - Comparison of cluster software
  - List of cluster management software
  - Intel DAOS
  - fio flexible I/O tester
  - cpuid - A software instruction available on Intel, AMD, and other processors that can be used to determine processor type and features.
  - intel cpuinfo - Intel tool providing information about the characteristics of Intel CPUs.
  - LIKWID.jl - Julia wrapper for LIKWID.
  - BeeGFS - A parallel file system designed for performance-critical environments.
  - Ceph - An open-source distributed storage system.
  - fpsync - A tool for fast parallel data transfer using fpart and rsync.
  - GPFS - A high-performance parallel file system developed by IBM.
  - Guix - A package manager for HPC/supercomputers.
  - OpenPBS - A software for workload management and job scheduling.
  - OpenXdMod - A tool for managing high-performance computing resources.
  - RADIUSS - Rapid Application Development via an Institutional Universal Software Stack.
  - rocks - An open-source Linux cluster distribution.
  - SGE - A resource management software for large clusters of computers.
  - Slurm - A cluster management and job scheduling system for Linux clusters.
  - Starfish - Unstructured data management and metadata solution for files and objects.
  - Warewulf - An operating system provisioning system and cluster management tool.
  - xCat - A distributed computing management and provisioning tool.
  - XDMoD - An open-source tool for managing high-performance computing resources.
  - Globus Connect - A fast data transfer tool between supercomputers.
  - Jacamar-ci - CI/CD tool designed for HPC and scientific computing workflows.
  - Kubernetes - An open-source system for automating deployment, scaling, and management of containerized applications.
  - nextflow - A workflow framework to deploy data-driven computational pipelines.
  - Prefect - A workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine.
  - Prometheus - An open-source monitoring system with a dimensional data model, flexible query language, efficient time series database and modern alerting approach.
  - snakemake - A workflow management system that reduces the complexity of creating reproducible and scalable data analyses.
  - Metal - Apple's GPU API
  - Intel DAOS - A software-defined scale-out object store for HPC applications.
  - Amira - A powerful, multifaceted 3D software platform for visualizing, manipulating, and understanding Life Science and bio-medical data coming from all types of sources.
  - paraview - An open-source, multi-platform data analysis and visualization application.
  - Scientific Visualization Wiki - A comprehensive guide to the field of scientific visualization, detailing techniques, tools, and applications.
  - vedo - A lightweight and powerful python module for scientific analysis and visualization of 3D objects and point clouds based on VTK.
  - HPL benchmark - The High Performance Linpack Benchmark for measuring floating-point computing power of systems.
  - EESSI - A shared stack of scientific software installations.
  - NASA parallel benchmark suite - A set of benchmarks designed to evaluate the performance of parallel supercomputers.
  - papi - Provides standard APIs for accessing hardware performance counters available on modern microprocessors.
  - scalasca - A software tool that supports performance analysis of large-scale parallel applications.
  - tau - TAU (Tuning and Analysis Utilities) is a profiling and tracing toolkit for performance analysis of parallel programs.
  - hpctoolkit - An integrated suite of tools for measurement and analysis of program performance on computers ranging from desktops to supercomputers.
  - Differential Flamegraphs - A visualization technique developed by Brendan Gregg that highlights differences between performance profiles, making it easier to spot performance regressions or improvements.
  - Openfoam HPC benchmark - A benchmarking suite for evaluating the High Performance Computing capabilities of OpenFOAM, an open-source CFD software, under various computational loads.
  - Slurm Web - Open source web dashboard for Slurm HPC clusters.
  - Open Cluster Scheduler - A scalable HPC/AI workload manager based on SGE.
  - STLab - High-level Constructs for Implementing Multicore Algorithms with Minimized Contention
  - OSU microbenchmarks - A collection of microbenchmarks designed to evaluate the performance of MPI implementations across various communication protocols and message sizes.
  - Roofline Visualizer for ERT - Visualizer for ERT
  - Empirical Roofline Tool (ERT) - Create empirical roofline plots, alternative to intel vtune for any machine
  - Triton - Triton is a language and compiler for parallel programming
  - hdf5 - The Hierarchical Data Format version 5 (HDF5), is an open source file format that supports large, complex, heterogeneous data.
Hardware
- Cloud
- Interconnects/Topology
- CPU
- Other/Wikis
- GPU
- TPU/Tensor Cores
  - NVIDIA Tensor Cores
  - Google TPU
- Many integrated core processor (MIC)
  - Xeon Phi
- Custom/FPGA/ASIC/APU
- Certification
  - Intel Cluster Ready
- Student Opportunities / Workshops
Resources
- Other/Wikis
General Info
- A Few Upcoming Supercomputers
  - El Capitan - 2023, AMD-based, ~1.5 exaflops
  - Tianhe-3 - 2022, ~700 Petaflop (Linpack500)
  - Venado - 2024, Grace-Hopper based ~10 exaflops
- Most Recent List of the Top500 Supercomputers
- History
- Trends
  - Trends in HPC for AI workloads
Other Curated Lists
- Other/Wikis
  - Princeton resources on OpenMP
  - Sig HPC Education

Programming Languages

C++ 22 Python 10 C 6 Shell 4 Rust 3 Dockerfile 1 TypeScript 1 Jinja 1 Cuda 1 Go 1

Categories

Resources 424 Software 181 Hardware 67 People 29 General Info 19 Other Curated Lists 2

Sub Categories

Other/Wikis 470 Trends 182 Cloud 13 GPU 11 CPU 9 Most Recent List of the Top500 Supercomputers 9 Interconnects/Topology 8 History 6 Student Opportunities / Workshops 4 A Few Upcoming Supercomputers 3 Custom/FPGA/ASIC/APU 3 TPU/Tensor Cores 2 Many integrated core processor (MIC) 1 Certification 1

Keywords

hpc 12 gpu 6 python 6 mpi 6 c-plus-plus 6 cuda 5 parallel-programming 5 parallel-computing 5 gpu-programming 5 cpp 4 linux 4 machine-learning 3 gpu-computing 3 deep-learning 3 parallel 3 intel 3 rust 3 data-science 3 c 3 heterogeneous-parallel-programming 3 high-performance-computing 3 benchmarking 2 nvidia-gpu 2 simd 2 slurm 2 slurm-cluster 2 threading 2 machinelearning 2 monitoring 2 pytorch 2 ray 2 tensorflow 2 kubernetes 2 distributed-computing 2 programming-model 2 docker 2 kokkos 2 pgas 2 async 2 shmem 2 compiler 2 openmp 2 openacc 2 cpp17 2 multithreading 2 macos 2 raja 1 taskflow 1 radiuss 1 taskparallelism 1