Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/getindata/jupyter-images

Receipes of publicly-available Jupyter images
https://github.com/getindata/jupyter-images

jupyter jupyter-notebook jupyterlab mlops mlops-environment

Last synced: about 1 month ago
JSON representation

Receipes of publicly-available Jupyter images

Awesome Lists containing this project

README

        

# Jupyter Images

This repository stores recipes of publicly-available Jupyter images

Latest versions:

```
gcr.io/getindata-images-public/jupyterlab-mlops:dev-0.2.9
```

## jupyterlab-base

Local copy of [jupyter/base-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook),
used to build and manage local versions of `base-notebook` image that are no longer published in offical repositories:

### jupyterlab-base:ubuntu-20.04.python-3.8

* conda-backed python 3.8.x environment
* Ubuntu 20.04 as base image

## jupyterlab-mlops

### jupyterlab-mlops:dev

Based on the [jupyter/pyspark-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-pyspark-notebook)
image with additional setup of:

* conda-backed python 3.9 environment
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* local [MLflow](https://mlflow.org/) server for experiment tracking
* additional conda environment with python 3.8 and [kedro](https://kedro.readthedocs.io/en/stable/) framework
* Istio-compatible Spark executor entrypoint

![jupyterlab-mlops-launcher](docs/jupyterlab-mlops-launcher.png)

### jupyterlab-mlops:python-3.11

Based on the [jupyter/minimal-notebook:python-3.11](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-minimal-notebook)
image with additional setup of:

* conda-backed python 3.11 environment with [kedro 0.19.8](https://docs.kedro.org/en/0.19.8/) framework
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
* local [MLflow](https://mlflow.org/) server for experiment tracking
* local [code-server](https://github.com/coder/code-server) as IDE accessed from the browser

![jupyterlab-mlops-launcher](docs/jupyterlab-mlops-launcher-3.11.png)

Compatibility:

- [x] [Kubeflow Notebook Servers](https://www.kubeflow.org/docs/components/notebooks/)
- [x] [Vertex AI Notebooks](https://cloud.google.com/vertex-ai/docs/general/notebooks)

## jupyterlab-dataops

Based on the [jupyter/minimal-notebook:python-3.11.4](https://hub.docker.com/layers/jupyter/minimal-notebook/python-3.11.4/images/sha256-1924d8d0adf9cf3646bf7fa3833a30e47d2b0a17a2b583556b37f015f208f115?context=explore)
image with additional setup:

- **jupyterhub-base** image
- [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
- **snowflake** image
- [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
- [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
- local [code-server](https://github.com/coder/code-server) as IDE accessed from the browser with
- [dbt Power User](https://marketplace.visualstudio.com/items?itemName=innoverio.vscode-dbt-power-user) extension pre-installed
- [data-pipelines-cli](https://github.com/getindata/data-pipelines-cli)
- [Snow SQL plugin](https://docs.snowflake.com/en/user-guide/snowsql)

Compatibility:

- [x] [JupyterHub](https://jupyter.org/hub)

## jupyterlab-streaming

Based on the [jupyter/base-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook)
image with additional setup:

* conda-backed python 3.8.8 environment
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
* [streaming-jupyter-integrations](https://github.com/getindata/streaming-jupyter-integrations) Jupyter magics for interactively running _Flink SQL_ jobs
* [streamingcli](https://github.com/getindata/streaming-cli) tool
* local [code-server](https://github.com/coder/code-server) as IDE

Compatibility:

- [x] [JupyterHub](https://jupyter.org/hub)

#### How to use this image?

In Kubeflow Notebooks select *Custom Image* checkbox and enter image location:

![jupyterlab-mlops-kubeflow](docs/jupyterlab-mlops-kubeflow.png)

In Vertex AI select *New instace -> Customize instance*, then in *Environment* select *Custom container*.
Finally, enter image location in *Docker container image* input:

![jupyterlab-mlops-vertexai](docs/jupyterlab-mlops-vertexai.png)