https://github.com/pyladiesams/kedro-prod-ready-ds-pipelines-aug2025
Refactor a typical data science notebook into a well-structured Kedro project, explore its core features and workflow and software engineering best practices.
https://github.com/pyladiesams/kedro-prod-ready-ds-pipelines-aug2025
data-science-pipeline data-science-pipelines data-science-production kedro
Last synced: 2 months ago
JSON representation
Refactor a typical data science notebook into a well-structured Kedro project, explore its core features and workflow and software engineering best practices.
- Host: GitHub
- URL: https://github.com/pyladiesams/kedro-prod-ready-ds-pipelines-aug2025
- Owner: pyladiesams
- License: mit
- Created: 2025-07-29T10:14:06.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2025-07-29T10:46:03.000Z (3 months ago)
- Last Synced: 2025-07-29T12:52:18.814Z (3 months ago)
- Topics: data-science-pipeline, data-science-pipelines, data-science-production, kedro
- Language: Jupyter Notebook
- Homepage:
- Size: 724 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Data science that ships: production-ready pipelines with Kedro
### Presentation: [{ YOUR PRESENTATION NAME }](workshop/presentation_template.pdf)
## Workshop description
In this hands-on workshop, we'll refactor a typical data science notebook into a well-structured Kedro project, exploring its core features and workflow and software engineering best practices.
## Requirements
* PyLadies Amsterdam uses [uv](https://docs.astral.sh/uv/) for dependency management
* Google account if you want to use [Google Colab](https://colab.research.google.com/)
## Usage
### with uv
Run the following code:
```bash
git clone
cd
# create and activate venv, install dependencies
uv sync
```
### with Google Colab
1. Visit [Google Colab](https://colab.research.google.com/)
2. In the top left corner select "File" → "Open Notebook"
3. Under "GitHub", enter the URL of the repo of this workshop
4. Select one of the notebooks within the repo.
5. At the top of the notebook, add a Code cell and run the following code:
```bash
!git clone
%cd
!pip install -r requirements.txt
```
### for a workshop giver
To get started, open the `pyproject.toml` file and set the required Python version. The pre-selected version 3.8 is generally a safe choice for most use cases.
After you have specified the Python version, you can create a virtual environment with `uv venv` and add packages with `uv add `. Before the workshop, you can generate a requirements.txt file, which is needed e.g. for running code in Google Colab, by running `uv export > requirements.txt`.
## Video record
Re-watch [this YouTube stream](https://www.youtube.com/live/Dcriovnobqo)
## Credits
This workshop was set up by @pyladiesams and @merelcht
## Appendix
### Pre-Commit Hooks
To ensure our code looks beautiful, PyLadies uses pre-commit hooks. You can enable them by running `pre-commit install`. You may have to install `pre-commit` first, using `uv sync`, `uv pip install pre-commit` or `pip install pre-commit`.
Happy Coding :)