Projects in Awesome Lists tagged with cluster-computing

https://github.com/splware/esproc

esProc SPL is a JVM-based programming language designed for structured data computation, serving as both a data analysis tool and an embedded computing engine.

cluster-computing database dataset esproc java sql

Last synced: 29 Apr 2025

https://github.com/SPLWare/esProc

esProc SPL is a scripting language for data processing, with well-designed rich library functions and powerful syntax, which can be executed in a Java program through JDBC interface and computing independently.

cluster-computing database dataset esproc java sql

Last synced: 04 Apr 2025

https://github.com/apache/sedona

A cluster computing framework for processing large-scale geospatial data

cluster-computing geospatial java python scala spatial-analysis spatial-query spatial-sql

Last synced: 12 Dec 2025

https://github.com/kaanaksit/odak

Scientific computing library for optics, computer graphics and visual perception

cluster-computing color computational-display computational-imaging computational-optics computer-generated-holography computer-graphics deep-learning holography jones-calculus lensless machine-learning numpy odak optics perception python pytorch raytracing wave-optics

Last synced: 05 Apr 2025

https://github.com/tsung-wei-huang/dtcraft

A High-performance Cluster Computing Engine

cluster-computing dataflow-programming distributed-systems event-driven-programming network-programming parallel-computing reactor stream-processing-engine streaming

Last synced: 14 Apr 2025

https://github.com/tlkh/prowler

Distributed Network Vulnerability Scanner

cluster-computing jupyter-notebook linux python raspberry-pi security

Last synced: 14 Jul 2025

https://github.com/lablup/all-smi

Command-line utility for monitoring GPU hardware.

backend-ai cluster-computing gpu monitoring-tool

Last synced: 08 Feb 2026

https://github.com/lf-edge/edge-home-orchestration-go

Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

cluster-computing container containerization data-storage docker edgecomputing hikey960 home-iot homeedge iot lfedge node orchestration raspberry-pi rbac

Last synced: 16 May 2025

https://github.com/inureyes/all-smi

Command-line utility for monitoring GPU hardware.

backend-ai cluster-computing gpu monitoring-tool

Last synced: 30 Aug 2025

https://github.com/fpicetti/occamypy

Python library for solving large-scale inverse problems

cluster-computing multiscale optimization optimization-algorithm-library optimization-algorithms

Last synced: 14 Jan 2026

https://github.com/pgiri/pycos

Concurrent, Asynchronous, Distributed, Communicating Tasks with Python

asynchronous-programming cluster-computing concurrent-programming distributed-computing message-passing python

Last synced: 21 Jan 2026

https://github.com/constantinpape/cluster_tools

Distributed segmentation for bio-image-analysis

3d-segmentation bio-image-analysis cluster-computing connectomics lifted-multicut microscopy-images multicut mutex-watershed segmentation watershed

Last synced: 08 Sep 2025

https://github.com/timtroendle/cookiecutter-reproducible-research

A cookiecutter template for reproducible research projects using Python, Snakemake, and Pandoc.

automation cluster-computing cookiecutter-template pandoc python reproducible-research snakemake

Last synced: 30 Dec 2025

https://github.com/lsds/seep

Cluster computing using Stateful Dataflow Graphs

cluster-computing dataflow-programming sdg stateful

Last synced: 02 Apr 2025

https://github.com/sereca/SecureKeeper

Secure ZooKeeper using Intel SGX

cluster-computing coordination enclave sgx trusted-execution zookeeper

Last synced: 20 Apr 2025

https://github.com/vfxpipeline/zone

Web based cluster computing apps

blender-python cluster-computing distributed-computing django-application django-rest-framework houdini houdini-plugin javascript maya maya-plugin nuke-plugin python render renderer rendering rendering-2d-graphics rendering-3d-graphics rendering-engine renderscript rest-api

Last synced: 30 Apr 2025

https://github.com/xd-deng/diy-a-cluster

How to Do-It-Yourself A Cluster for Spark & Hadoop

cluster-computing hadoop spark

Last synced: 15 Apr 2025

https://github.com/shenfe/clusterun

💠 Run tasks in cluster mode easily, for CPU-intensive programs.

cluster cluster-computing multiprocessing nodejs parallel-programming

Last synced: 10 Apr 2025

https://github.com/mlr-org/mlr3batchmark

Connector between mlr3 and batchtools

batchtools cluster-computing high-performance-computing hpc mlr3 r r-package

Last synced: 09 Apr 2025

https://github.com/meetps/glustup

Tools and Instruction Sets for GPU cluster setup.

cluster-computing nvidia-gpus

Last synced: 28 Jan 2026

https://github.com/sodascience/workshop_ossc

This repository contains the code and presentation of the workshop on parallel computing & cluster computing using R in collaboration with SURF.

agent-based-modeling cluster-computing high-performance-computing odissei parallel-computing r simulation surf

Last synced: 30 Jul 2025

https://github.com/diegofps/pywup

Parallelize any experiment and collect results from their stdout

cluster-computing multiprocessing plotting regex

Last synced: 14 Jan 2026

https://github.com/nareddyt/mpi-hello-world

Hello World for MPI with support for CLion and Gatech PACE

clion cluster-computing gatech mpi

Last synced: 01 Mar 2025

https://github.com/is0xjh25/social-media-analytics-on-cloud

The is team 67's solution that can be run across any node of the UniMelb Research Cloud to harvest and store social media data and scale up/down as required with the data being harvested, processed and incorporated into the existing CouchDB database.

ansible cluster-computing python

Last synced: 22 Mar 2025

https://github.com/janeliascicomp/jacs-compute

JAnelia Compute Services (JACS)

cluster-computing distributed-computing neuroimaging

Last synced: 21 Feb 2025

https://github.com/JaneliaSciComp/jacs-compute

JAnelia Compute Services (JACS)

cluster-computing distributed-computing neuroimaging

Last synced: 16 Apr 2025

https://github.com/astrolabsoftware/astrolabsoftware.github.io

Website for AstroLab

apache-spark cluster-computing functional-programming research

Last synced: 11 Oct 2025

https://github.com/sciencegenome/rust-connect

a rustlang devops/system administration application

cluster-computing high-performance-computing rust-library slurm-job-scheduler slurm-workload-manager system-administration system-programming

Last synced: 18 Mar 2025

https://github.com/gauravcodepro/docker-ruby-lister

I coded a ruby class coded to get all the information on the running docker containers with their names and sizes. You can initialize the class and then pull all the information.

cluster-computing docker docker-container docker-image swarm-cluster

Last synced: 22 Feb 2025

https://github.com/applicativesystem/rust-connect

a rustlang devops/system administration application

cluster-computing high-performance-computing rust-library slurm-job-scheduler slurm-workload-manager system-administration system-programming

Last synced: 15 Aug 2025

https://github.com/antonystorti/data-management-systems

Data Management Systems (NoSQL) - CdS Magistrale in "Ingegneria Informatica" (LM-32)

cluster-computing data-engineering mongodb neo4j nosql-database python

Last synced: 12 Jun 2025

https://github.com/bow/virtual-clusters

Recipes for setting up a local virtual cluster using specific scheduling engines.

cluster-computing scheduling-engines vagrant virtual-clusters virtual-machine

Last synced: 24 Jan 2026

https://github.com/gauravcodepro/zenity-docker-nu

a zenity app for the docker subnet masking check with nu rust programming. I coded this earlier also for slurm and pbs and now put it for the docker also. you can define your docker processid and it will get the netmask for the same so that you can connect to those instances easily. I coded this for the slurm and pbs cluster

cluster-computing docker nushell nushell-core nushell-script

Last synced: 15 Jun 2025

https://github.com/gauravcodepro/warp-workflow

a warp workflow builder which uses the shell in built array addition and adds your commands to the in-built array declaration

array-methods arrays cluster-computing rust shellcode warp workflow

Last synced: 27 Mar 2025

https://github.com/gauravcodepro/docker-visual

applied nushell rust programming approach to docker containerization and created arrays from the same. A fresh way to view the docker containerization

cluster-computing docker docker-container docker-images dockerfiles

Last synced: 22 Feb 2025

https://github.com/perfectlysoft/perfect-libzookeeper

native C library for ZooKeeper (Linux Only)

cluster-computing clustered-servers zookeeper

Last synced: 02 Mar 2025

https://github.com/coatless-textbooks/hpc

Short textbook on Cluster Computing Workflow using R

cluster-computing hpc r

Last synced: 17 Mar 2025

https://github.com/dsst95/r-cluster

A cluster-computing platform for R scripts

cluster-computing parallel-computing r

Last synced: 03 Apr 2025

https://github.com/gauravcodepro/docker-network-latency-plotter

a docker network latency plotter coded which is a part of the bundle docker swarm management and this subpart will check and plot all the docker network latency and also prune them if they are sleeping or are dead

cluster-computing docker docker-container docker-swarm dockernetwork dockernetworking

Last synced: 22 Feb 2025

https://github.com/matthewwolak/hpc

Templates and example code used for cluster computing and other high performance computing applications

cluster-computing hpc parallel-computing

Last synced: 23 Jan 2026

https://github.com/gauravcodepro/awk-plotter

a awk based sort index way to plot the files or the directories across the dockers and intergrate this in your ~/.bashrc or the ~./zshrc or a cron job for managing the disk space across dockers

awk awk-programming-language cluster-computing containers docker filesystem watcher