Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/getindata/jupyter-images
Receipes of publicly-available Jupyter images
https://github.com/getindata/jupyter-images
jupyter jupyter-notebook jupyterlab mlops mlops-environment
Last synced: about 1 month ago
JSON representation
Receipes of publicly-available Jupyter images
- Host: GitHub
- URL: https://github.com/getindata/jupyter-images
- Owner: getindata
- License: mit
- Created: 2021-09-13T10:29:03.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2024-09-13T13:22:13.000Z (3 months ago)
- Last Synced: 2024-09-14T22:24:56.734Z (3 months ago)
- Topics: jupyter, jupyter-notebook, jupyterlab, mlops, mlops-environment
- Language: Shell
- Homepage:
- Size: 22 MB
- Stars: 8
- Watchers: 15
- Forks: 4
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Jupyter Images
This repository stores recipes of publicly-available Jupyter images
Latest versions:
```
gcr.io/getindata-images-public/jupyterlab-mlops:dev-0.2.9
```## jupyterlab-base
Local copy of [jupyter/base-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook),
used to build and manage local versions of `base-notebook` image that are no longer published in offical repositories:### jupyterlab-base:ubuntu-20.04.python-3.8
* conda-backed python 3.8.x environment
* Ubuntu 20.04 as base image## jupyterlab-mlops
### jupyterlab-mlops:dev
Based on the [jupyter/pyspark-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-pyspark-notebook)
image with additional setup of:* conda-backed python 3.9 environment
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* local [MLflow](https://mlflow.org/) server for experiment tracking
* additional conda environment with python 3.8 and [kedro](https://kedro.readthedocs.io/en/stable/) framework
* Istio-compatible Spark executor entrypoint![jupyterlab-mlops-launcher](docs/jupyterlab-mlops-launcher.png)
### jupyterlab-mlops:python-3.11
Based on the [jupyter/minimal-notebook:python-3.11](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-minimal-notebook)
image with additional setup of:* conda-backed python 3.11 environment with [kedro 0.19.8](https://docs.kedro.org/en/0.19.8/) framework
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
* local [MLflow](https://mlflow.org/) server for experiment tracking
* local [code-server](https://github.com/coder/code-server) as IDE accessed from the browser![jupyterlab-mlops-launcher](docs/jupyterlab-mlops-launcher-3.11.png)
Compatibility:
- [x] [Kubeflow Notebook Servers](https://www.kubeflow.org/docs/components/notebooks/)
- [x] [Vertex AI Notebooks](https://cloud.google.com/vertex-ai/docs/general/notebooks)## jupyterlab-dataops
Based on the [jupyter/minimal-notebook:python-3.11.4](https://hub.docker.com/layers/jupyter/minimal-notebook/python-3.11.4/images/sha256-1924d8d0adf9cf3646bf7fa3833a30e47d2b0a17a2b583556b37f015f208f115?context=explore)
image with additional setup:- **jupyterhub-base** image
- [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
- **snowflake** image
- [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
- [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
- local [code-server](https://github.com/coder/code-server) as IDE accessed from the browser with
- [dbt Power User](https://marketplace.visualstudio.com/items?itemName=innoverio.vscode-dbt-power-user) extension pre-installed
- [data-pipelines-cli](https://github.com/getindata/data-pipelines-cli)
- [Snow SQL plugin](https://docs.snowflake.com/en/user-guide/snowsql)Compatibility:
- [x] [JupyterHub](https://jupyter.org/hub)
## jupyterlab-streaming
Based on the [jupyter/base-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook)
image with additional setup:* conda-backed python 3.8.8 environment
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
* [streaming-jupyter-integrations](https://github.com/getindata/streaming-jupyter-integrations) Jupyter magics for interactively running _Flink SQL_ jobs
* [streamingcli](https://github.com/getindata/streaming-cli) tool
* local [code-server](https://github.com/coder/code-server) as IDECompatibility:
- [x] [JupyterHub](https://jupyter.org/hub)
#### How to use this image?
In Kubeflow Notebooks select *Custom Image* checkbox and enter image location:
![jupyterlab-mlops-kubeflow](docs/jupyterlab-mlops-kubeflow.png)
In Vertex AI select *New instace -> Customize instance*, then in *Environment* select *Custom container*.
Finally, enter image location in *Docker container image* input:![jupyterlab-mlops-vertexai](docs/jupyterlab-mlops-vertexai.png)