awesome-kedro

Plugins, extensions, case studies, articles, and video tutorials for Kedro
https://github.com/kedro-org/awesome-kedro

Last synced: 2 days ago
JSON representation

Blog posts
Companies using Kedro
Example projects
- Churn Prediction with Kedro - ready machine learning model.
- Augury - learning functionality for predicting AFL match results in the Tipresias app
- CausalLift - world business
- PipelineX
- kedro-mlflow-example
- kedro-wdbc-tf
- Anomaly Detection Pipeline with Kedro
- FontR
- Spaceship-Titanic using Kedro and MLflow - Titanic Kaggle competition with a fully automated machine learning lifecycle using Kedro and MLflow.
- pipelinex_image_processing - image, TensorFlow/Keras, and MLflow.
- Price Prediction Pipeline - A-D-S), a data processing and data science pipeline for a ficticious Diamond enterprise using Scikit-Learn, Docker and Pandas.
- Healthcare Data Analysis with Kedro
- Spaceflights price prediction as a service and Monte Carlo simulations - boot) to serve the spaceflights price prediction model through Rest API (FatApi) and Data App (Streamlit). It also provides an example of a Monte Carlo simulations for estimating Pi using [Kedro Boot](https://github.com/takikadiri/kedro-boot).
- twitter-sentiment-analysis - based machine learning model.
- Response Recommendation System for BarefootLaw
[Kedro plugins](https://docs.kedro.org/en/stable/extend_kedro/plugins.html)
- kedro-sagemaker - Enables running a Kedro pipeline with Amazon SageMaker service.
- kedro-snowflake - Enables to run full Kedro pipelines in Snowflake.
- kedro-softfail-runner - Custom Kedro Runner to enable soft-failing pipeline.
- kedro-static-viz - Generates a static Kedro-Viz site (HTML, CSS, JS)
- kedro-vertexai - Enables running a Kedro pipeline with Vertex AI Pipelines service.
- kedro-accelerator - Speeds up pipelines by parallelizing I/O in the background.
- find-kedro - Automatically construct pipelines using pytest style pattern matching.
- kedro-airflow-k8s - Enables running a Kedro pipeline with Airflow on a Kubernetes cluster.
- kedro-auto-catalog - A configurable replacement for kedro catalog create that allows you to create default dataset types other than `MemoryDataset`.
- kedro-azureml - Enables running a Kedro pipeline with Azure ML Pipelines service.
- kedro-dataframe-dropin - Lets you swap out pandas datasets for modin or RAPIDs equivalents for specialised use to speed up your workflows (e.g on GPUs).
- kedro-great - The easiest way to integrate Kedro and Great Expectations.
- kedro-kubeflow - Lets you run and schedule pipelines on Kubernetes clusters using Kubeflow Pipelines.
- kedro-neptune - Integration of Kedro with Neptune.ai.
- kedro-partitioned - Extends the functionality on processing partitioned data.
- kedro-tf-image - Kedro pipelines for preprocessing images using TensorFlow.
- kedro-boot - Integrate you kedro project with any application
- kedro-popmon - A Kedro plugin for integration of popmon capabilities.
- kedro-pandera - Integration of Kedro with Pandera to provide catalog-level data validation.
- kedro-airflow - Makes it easy to deploy Kedro projects to Airflow.
- kedro-argo - Converts Kedro pipelines to Argo pipelines.
- kedro-datasets - A collection of Kedro data connectors.
- kedro-docker - Makes it easy to package Kedro projects with Docker.
- kedro-fast-api - kedro fast-api is a kedro plugin to easily create a fast-api for a kedro project for models' deployment.
- kedro-grpc-server - Creates a gRPC server for your kedro pipelines.
- kedro-mlflow - Allows usage of MLFlow in Kedro projects.
- kedro-pandas-profiling - "Profiles" data in the catalog. (⚠️public archive)
- kedro-viz - Helps visualise Kedro data and analytics pipelines.
- kedro-wings - Automatically creates catalog entries to simplify Kedro pipeline writing.- [more-kedro](https://pypi.org/project/more-kedro/) - (Hook) library for on the fly typing and validation of parameter dictionaries and default value backed data loading.
- steel-toes - Prevent changing downstream catalog data on your teammates while developing in parallel.
- kedro-graphql - A Kedro plugin for serving Kedro projects as GraphQL APIs.
- kedro-plugin
- kedro-expectations - Adding Data Validation to Kedro pipelines with up-to-date Great Expectations version.
- vineyard-kedro - Custom `DataSet` and `Runner` which enables sharing intermediate data between tasks in Kedro pipelines using Vineyard, a cloud-native in-memory object manager.
- kedro-dolt - Allows you to expand the data versioning abilities of data scientists and engineers
- kedro-accelerator - Speeds up pipelines by parallelizing I/O in the background.
Awards and highlights
- Best Technical Tool or Framework for AI
- UK Technical Communication Awards 2020 - development-and-recognition/uk-technical-communication-awards/award-winners-2023/).
- ThoughtWorks Technology Radar - and-frameworks/kedro).
- honorable mention in the User Experience category in Fast Company’s 2022 Innovation by Design Awards
Videos
- Intros
- Howtos
  - @kedro-python on YouTube
  - Refactor your Jupyter notebooks using Kedro
  - Introduction to Kedro training with Joel Schwarzmann
  - Creating Shared Catalogs for your Kedro Projects on GitHub
  - Deployable REST Enabled Data Pipelines with Flask, Docker, Kedro
  - How to begin writing tests for your Pipelines
  - How To Customize Your Kedro CLI Options
  - How to Get/Write Data from/to a SQL Database - Use `pandas.SQLTableDataSet` or `pandas.SQLQueryDataSet`.
  - How to Lazily Evaluate Chunks of a Big Pandas DataFrame
  - How to Setup PySpark for your Kedro Pipeline
  - Kedro Great: Use Great Expectations with Ease! - Show how to use kedro-great to e.g. validate data container meta data (columns, etc.).
  - Run machine learning pipelines on ❄ Snowflake using Kedro 🔧 MLOPS TUTORIAL
  - Kedro + PyTorch. MLOps TUTORIAL by Marcin Zabłocki
  - Kedro + AWS SageMaker TUTORIAL
  - How to run Kedro pipelines on Azure ML Pipelines service? - MLOPS TUTORIAL - Marcin Zabłocki
  - Kedro Community Update - April 2023 - Kedro 0.18.7, new `OmegaConfigLoader`, experiment tracking in Kedro Viz, improvements in Databricks workflow, and more.
  - Let's look at Kedro 0.17.0!
  - Kedro 0.16.0 was just Released! - Release notes (features) of Kedro 0.16.0 explained.
  - Why transition from vanilla Jupyter notebooks to Kedro?
  - Why transition from vanilla Jupyter notebooks to Kedro?

Programming Languages

Python 26 Jupyter Notebook 6

Categories

Blog posts 194 Companies using Kedro 46 [Kedro plugins](https://docs.kedro.org/en/stable/extend_kedro/plugins.html) 36 Videos 30 Example projects 15 Awards and highlights 4

Sub Categories

Howtos 20 Intros 10

Keywords

kedro 14 kedro-plugin 10 mlops 8 machinelearning 5 python 5 machine-learning 4 data-science 3 data 3 kedro-catalog 2 kedro-hook 2 ml 2 pipelines 2 machine-learning-pipeline 1 quantumblack 1 classification 1 pytorchlightning 1 fraud-detection 1 fraud 1 financial-data 1 wandb 1 financial 1 data-science-pipeline 1 airport 1 airport-simulation 1 usg-ai-training-data 1 usg-artificial-intelligence 1 causal-impact 1 causal-inference 1 causality 1 counterfactual 1 econometrics 1 propensity-score 1 propensity-scores 1 uplift 1 uplift-modeling 1 data-engineering 1 deep-learning 1 experimentation 1 pipeline 1 anomaly 1 anomaly-detection 1 credit-card 1 credit-card-fraud 1 kubeflow 1 kubeflow-pipelines 1 dashboard 1 experiment 1 node 1 nodes 1 organize 1