https://github.com/sanogotech/hellospark

https://github.com/sanogotech/hellospark

spark

Last synced: 7 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/sanogotech/hellospark
• Owner: sanogotech
• Created: 2020-08-31T14:45:48.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-08-31T16:03:47.000Z (over 4 years ago)
• Last Synced: 2024-12-16T07:19:45.282Z (2 months ago)
• Topics: spark
• Language: Python
• Homepage:
• Size: 284 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# hellospark

## Install

wget http://apache.crihan.fr/dist/spark/spark-2.3.1/spark-2.3.1-bin-hadoop2.7.tgz

tar xzf spark-2.3.1-bin-hadoop2.7.tgz

$ wget http://classics.mit.edu/Homer/iliad.mb.txt

## Run

./spark-2.3.1-bin-hadoop2.7/bin/spark-submit ./wordcount.py ./text.txt

## Run  Dist

park-2.3.1-bin-hadoop2.7/bin/spark-submit --master local[4] ../spark/wordcount/wordcount.py ./iliad100.txt