Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

SQL-NoSQL-Guide

SQL/NoSQL DB Guide. Learn about SQL/NoSQL databases & Distributed Systems.
https://github.com/mikeroyal/SQL-NoSQL-Guide

Last synced: 9 days ago
JSON representation

Distributed Systems Learning Resources

Courses & Tutorials

Distributed Systems Courses & Tutorials

Distributed Systems Tools

Parallel Systems Courses & Tutorials

  • Extract, transform, and load (ETL)
  • Apache Flume
  • Apache Spark™ - scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
  • Apache PredictionIO
  • BigDL
  • Apache Beam - specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs).
  • Jupyter Notebook - source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Jupyter is used widely in industries that do data cleaning and transformation, numerical simulation, statistical modeling, data visualization, data science, and machine learning.
  • OpenMP - platform shared-memory parallel programming in C/C++ and Fortran. The OpenMP API defines a portable, scalable model with a simple and flexible interface for developing parallel applications on platforms from the desktop to the supercomputer.
  • CUDA®
  • Message Passing Interface (MPI) - passing standard designed to function on parallel computing architectures.
  • Microsoft MPI (MS-MPI)
  • Slurm - source workload manager designed specifically to satisfy the demanding needs of high performance computing.
  • AWS ParallelCluster - supported open source cluster management tool that makes it easy for you to deploy and manage High Performance Computing (HPC) clusters on AWS. ParallelCluster uses a simple text file to model and provision all the resources needed for your HPC applications in an automated and secure manner.
  • XGBoost
  • Apache Arrow - independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware like CPUs and GPUs.
  • Parallel Computing Toolbox™ - intensive problems using multicore processors, GPUs, and computer clusters. High-level constructs such as parallel for-loops, special array types, and parallelized numerical algorithms enable you to parallelize MATLAB® applications without CUDA or MPI programming. The toolbox lets you use parallel-enabled functions in MATLAB and other toolboxes. You can use the toolbox with Simulink® to run multiple simulations of a model in parallel. Programs and models can run in both interactive and batch modes.
  • Statistics and Machine Learning Toolbox™
  • Portable Batch System (PBS) Pro
  • Cluster Manager for Apache Kafka(CMAK)
  • Numba - aware optimizing compiler for Python sponsored by Anaconda, Inc. It uses the LLVM compiler project to generate machine code from Python syntax. Numba can compile a large subset of numerically-focused Python, including many NumPy functions. Additionally, Numba has support for automatic parallelization of loops, generation of GPU-accelerated code, and creation of ufuncs and C callbacks.
  • XGBoost

NoSQL Learning Resources

Courses & Tutorials

Parallel Systems Learning Resources

Distributed Systems Courses & Tutorials

Parallel Systems Courses & Tutorials

SQL Learning Resources

SQL Courses & Tutorials