https://github.com/kevinknights29/apache-spark-python

This project applies the concepts learn from the course: apache-spark-programming-in-python-for-beginners
https://github.com/kevinknights29/apache-spark-python

docker jupyter-notebook pyspark python

Last synced: 23 days ago
JSON representation

This project applies the concepts learn from the course: apache-spark-programming-in-python-for-beginners

• Host: GitHub
• URL: https://github.com/kevinknights29/apache-spark-python
• Owner: kevinknights29
• License: mit
• Created: 2023-08-26T22:24:27.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-08-27T00:35:04.000Z (about 1 year ago)
• Last Synced: 2024-05-08T00:23:57.701Z (6 months ago)
• Topics: docker, jupyter-notebook, pyspark, python
• Language: Jupyter Notebook
• Homepage:
• Size: 8.79 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Apache-Spark-Python

This project applies the concepts learn from the course: Apache Spark Programming in Python for beginners.

Course Link: [link](.udemy.com/course/apache-spark-programming-in-python-for-beginners/learn/)

## Usage

![image](https://github.com/kevinknights29/Apache-Spark-Python/assets/74464814/b86cd77b-9e49-4a8a-9122-8467abc8f862)

1. For first time usage, you need to build the Docker image:

    ```bash

    docker compose build .

    ```

2. After that you can start the container with:

    ```bash

    docker compose up -d

    ```

3. Go to Docker desktop, to retrieve your jupyterlab access URL.

    - Click the container name, to open the logs.

    - Retrive the jupyterlab URL, it should look like: `http://127.0.0.1:8888/lab?token=4150032f3603c85febf54b8b40bb761a2eb46e2fb593d5dc`

    ![image](https://github.com/kevinknights29/Airflow_Docs_LLM_App/assets/74464814/661f3747-2b2e-4387-9c79-64af1d8bc56e)

4. To stop the container, run:

    ```bash

    docker compose down

    ```