Projects in Awesome Lists tagged with spark-shell
A curated list of projects in awesome lists tagged with spark-shell .
https://github.com/aimanamri/raspberry-pi4-hadoop-spark-cluster
This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.
big-data distributed-storage hadoop-cluster hdfs parallel-processing pyspark raspberry-pi-4 spark-cluster spark-shell yarn
Last synced: 09 Apr 2025
https://github.com/hindog/grid-executor
Library for remote JVM ExecutorService with only dependency being password-less SSH -- Run clustered Hadoop/Spark jobs from IDE -- IDE-pimped Spark shell with full auto-completion!
cloud grid hadoop ide jvm spark-shell
Last synced: 13 Mar 2025
