Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/waylonwalker/kedro-static-viz
kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.
https://github.com/waylonwalker/kedro-static-viz
data dataengineering datapipeline kedro kedro-plugin python
Last synced: about 1 month ago
JSON representation
kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.
- Host: GitHub
- URL: https://github.com/waylonwalker/kedro-static-viz
- Owner: WaylonWalker
- License: mit
- Created: 2020-03-06T16:44:40.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2023-01-06T02:40:37.000Z (almost 2 years ago)
- Last Synced: 2024-10-29T05:34:49.956Z (about 2 months ago)
- Topics: data, dataengineering, datapipeline, kedro, kedro-plugin, python
- Language: Python
- Homepage: https://static-viz.kedro.dev
- Size: 13.6 MB
- Stars: 27
- Watchers: 6
- Forks: 2
- Open Issues: 30
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: contributing.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# [![Kedro-Static-Viz](./artwork/headers/1.png)](https://static-viz.kedro.dev)
Kedro-Static-Viz creates a static website for your [Kedro](https://github.com/quantumblacklabs/kedro) data pipelines. Kedro static viz is a very small python cli that makes your kedro-viz generated pipeline.json data available to a static appication built with gatsbyjs. The benefit of this is that it it can be built inside of a ci service such as github actions and deployed to a number to static file hosts such as Netlify, Now.sh, github pages, S3. Free options are endless these days. By default the site will be built to the `public` directory.
![Python package](https://github.com/WaylonWalker/kedro-static-viz/workflows/Python%20package/badge.svg?branch=master)
[![PyPI version](https://badge.fury.io/py/kedro-static-viz.svg)](https://badge.fury.io/py/kedro-static-viz)
![Build public.tar.gz and Deploy example to gh-pages](https://github.com/WaylonWalker/kedro-static-viz/workflows/Build%20public.tar.gz%20and%20Deploy%20example%20to%20gh-pages/badge.svg?branch=master)
---
## ![Example Site](./artwork/headers/2.png)
On every push to master in this repo [static-viz.kedro.dev](https://static-viz.kedro.dev) is built and deployed.
## ![CLI Usage](./artwork/headers/3.png)
```
kedro static-viz
```## !![Python Usage](./artwork/headers/4.png)
The `static_viz` function is callable from inside your project directory.
```python
from kedro_static_viz import static_viz
static_viz()
```## ![Hooks Usage](./artwork/headers/5.png)
``` python
from kedro_static_viz.hooks import StaticVizclass ProjectContext(KedroContext):
project_name = "kedro0160"
project_version = "0.16.1"
package_name = "kedro0160"
hooks = [ StaticViz() ]
```![](./artwork/kedro-static-viz-0-0-1.gif)
## ![Installation](artwork/headers/6.png)
## How do I install and use Kedro-Static-Viz?
### As a Kedro Python plugin
Kedro-Static-Viz is available as a Python plugin named `kedro-static-viz`.
The following conditions must be true in order to visualise your pipeline:
- Your project directory must be available to the Kedro-Static-Viz plugin.
- You must be using a [Kedro](https://github.com/quantumblacklabs/kedro) data pipelines project structure with a complete Data Catalog, nodes and pipeline structure.To install it:
```bash
pip install kedro-static-viz
```This will install `kedro` as a dependency, and add `kedro static-viz` as an additional CLI command.
To visualise your pipeline, go to your project root directory and install the project-specific dependencies by running:
```bash
kedro install
```This will install the dependencies specified in `requirements.txt` in your Kedro environment (see [the Kedro documentation](https://kedro.readthedocs.io/en/latest/02_getting_started/01_prerequisites.html#python-virtual-environments) for how to set up your Python virtual environment).
Finally, run the following command from the project directory to visualise your pipeline:
```bash
kedro static-viz
```This command will run kedro_viz.server on `http://127.0.0.1:4141/` which cannot be accessed from another machine.
Kedro-Viz has a number of options to customise running the visualisation:
| CLI command | Description |
|--------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| `--port` | TCP port that viz will listen to. Defaults to 4141. |
| `--browser/--no-browser` | Whether to open viz interface in the default browser or not. |
| `--load-file` | Path to load the pipeline JSON file |
| `--pipeline` | Name of the [modular pipeline](https://kedro.readthedocs.io/en/latest/04_user_guide/06_pipelines.html#modular-pipelines) to visualise. If not set, the default pipeline is visualised. |
| `--env`, `-e` | Kedro configuration environment. If not specified, catalog config in `local` will be used. |
| `--directory` | Directory to render the static site to |
| `--serve/--no-serve` | Whether or not to serve the site after creating. Defaults to True. |## ![Contributing](./artwork/headers/7.png)
**You're Awesome** for considering a contribution! Contributions are welcome, please check out the [Contributing Guide](./contributing.md) for more information. Please be a positive member of the community and embrace feedback
## ![Versioning](./artwork/headers/8.png)
We use [SemVer](https://semver.org/) for versioning. For the versions available, see the [tags on this repository](./tags).
## ![Authors](./artwork/headers/9.png)
[![Waylon Walker](https://avatars1.githubusercontent.com/u/22648375?s=120&v=4)](https://github.com/WaylonWalker) - Waylon Walker - _Original Author_
## ![License](./artwork/headers/10.png)
This project is licensed under the MIT License - see the LICENSE file for details