https://github.com/conorheffron/ironoc-spark

Sample pyspark Notebook
https://github.com/conorheffron/ironoc-spark

jupyter-notebook pyspark-notebook python3

Last synced: 12 days ago
JSON representation

Sample pyspark Notebook

• Host: GitHub
• URL: https://github.com/conorheffron/ironoc-spark
• Owner: conorheffron
• Created: 2024-09-23T07:32:50.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-10-07T13:37:17.000Z (3 months ago)
• Last Synced: 2024-12-22T20:53:58.772Z (17 days ago)
• Topics: jupyter-notebook, pyspark-notebook, python3
• Language: Jupyter Notebook
• Homepage: https://github.com/conorheffron/ironoc-spark/blob/main/task-1-nb.ipynb
• Size: 16.6 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# ironoc-spark

Run Jupyter Notebook via Docker & map workspace location:

```shell

docker run -p 8888:8888 -v /Users/conorheffron/workspace/ironoc-spark:/home/jovyan jupyter/minimal-notebook

```

Run Jupyter Notebook via Docker with PySpark & JDK pre-installed:

```shell

docker run -it --rm -p 8888:8888 jupyter/pyspark-notebook

```

- Add csv, json & ipynb files to workspace directory

[Jupyter Notebook](https://github.com/conorheffron/ironoc-spark/blob/main/task-1-nb.ipynb)