Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kedro-org/kedro-community
Examples of data science projects created with Kedro.
https://github.com/kedro-org/kedro-community
example example-project hacktoberfest kedro tutorial-code
Last synced: 3 months ago
JSON representation
Examples of data science projects created with Kedro.
- Host: GitHub
- URL: https://github.com/kedro-org/kedro-community
- Owner: kedro-org
- License: apache-2.0
- Archived: true
- Created: 2019-05-15T16:13:55.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2023-06-02T15:14:43.000Z (over 1 year ago)
- Last Synced: 2024-06-27T18:53:35.480Z (4 months ago)
- Topics: example, example-project, hacktoberfest, kedro, tutorial-code
- Language: Vue
- Homepage: https://quantumblacklabs.github.io/kedro-community/1
- Size: 19.4 MB
- Stars: 168
- Watchers: 15
- Forks: 44
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
## What is `kedro-community`?
> **Warning**
> This repository is archived in favor of https://github.com/kedro-org/awesome-kedro.---
This repo contains links to articles, podcasts and videos about Kedro, as well as community created examples of Kedro projects.
[![GitHub Discussions](https://img.shields.io/github/discussions/kedro-org/kedro?logo=GitHub)](https://github.com/kedro-org/kedro/discussions)
If you're looking to engage with the community then we suggest checking our [Slack organization](https://slack.kedro.org) or [GitHub discussions](https://github.com/kedro-org/kedro/discussions).
## Become a Kedroid
This is our affectionate term for power users and people who really help out other users in the community. Do get involved and, we'll do our best to make sure you earn the official Kedroid [badge of honour](./artwork/kedroid.png)
## Public Showcases
|Date|Deck|Recording|
|---|---|---|
|June 2020|[Link](https://github.com/kedro-org/kedro-community)|[YouTube link](https://youtu.be/fULOrO-QpsE)|## Where can I find more example projects using Kedro?
The Kedro team maintains the following official Kedro tutorial projects, also known as starters:
- [Spaceflights tutorial](https://github.com/kedro-org/kedro-starters/tree/main/spaceflights)
- [Iris dataset tutorial with pandas](https://github.com/kedro-org/kedro-starters/tree/main/pandas-iris)
- [Iris dataset tutorial with pyspark](https://github.com/kedro-org/kedro-starters/tree/main/pyspark)Our community of Kedro users are creating their own profile projects, you can have a look at:
- [Response Recommendation System for BarefootLaw](https://github.com/dssg/barefoot-winnie-public) by Kasun Amarasinghe, Carlos Caro, Nupoor Gandhi and Raphaelle Roffo, an extensive Data Science for Social Good (DSSG) at Imperial College London project that recommends responses to law related queries
- [Augury](https://github.com/tipresias/augury) by [Craig Franklin](https://github.com/cfranklin11), machine-learning functionality for predicting AFL match results in the Tipresias app
- [CausalLift](https://github.com/Minyus/causallift) by [Yusuke Minami](https://github.com/Minyus), a Python package for Uplift Modeling in real-world business
- [PipelineX](https://github.com/Minyus/pipelinex) by [Yusuke Minami](https://github.com/Minyus), a Python package to develop pipelines for rapid Machine/Deep Learning experimentation using Kedro and MLflow. Example projects using PyTorch, Pandas, and OpenCV are available.
- [kedro-mlflow-example](https://github.com/tgoldenberg/kedro-mlflow-example) by [Tom Goldenberg](https://github.com/tgoldenberg), a project that demonstrates how to integrate MLflow with a Kedro codebase
- [kedro-wdbc-tf](https://github.com/abhinavsp0730/kedro-wdbc-tf) by [Abhinav Prakash](https://github.com/abhinavsp0730), this project uses a Kedro template to create Deep Learning workflow. The model training was done with TensorFlow against the wdbc (Breast Cancer) dataset.
- [twitter-sentiment-analysis](https://github.com/aviagarwal1212/twitter-sentiment-analysis/blob/main/README.md) by [Avi Agarwal](https://github.com/aviagarwal1212), a project that demonstrates how to use Kedro to train and evaluate an NLP-based machine learning model.
- [Anomaly Detection Pipeline with Kedro](https://github.com/kennethleungty/Anomaly-Detection-Pipeline-Kedro) by [Kenneth Leung](https://github.com/kennethleungty), a project that demonstrates how to use Kedro for fraud detection on credit card transaction data using an Isolation Forest machine learning model.
You can find a useful list of Kedro-related plugins, blog posts, videos, and other resources over on [Florian Kromer's Github awesome-kedro repository](https://github.com/fkromer/awesome-kedro).## Where can I find articles, podcasts and videos about Kedro?
| Date | Title | Author | Channel | Format | Language |
|------------|-------------------------------------------------------------------------------------|-----------------------------|-------------------------------|--------------|------------|
| 22/07/2022 | [Building and Managing Data Science Pipelines with Kedro](https://neptune.ai/blog/data-science-pipelines-with-kedro) | Kenneth Leung | Neptune Blog | Article | English |
| N/A | [Deploying Kedro Pipelines to Apache Airflow](https://www.astronomer.io/guides/airflow-kedro) | astronomer.io | Astronomer Blog | Article | English |
| 13/09/2021 | [Writing your first kedro Nodes](https://waylonwalker.com/kedro-your-first-nodes/) | Waylon Walker | Personal Blog | Article | English |
| 19/09/2021 | [Setting Parameters in kedro](https://waylonwalker.com/kedro-parameters/) | Waylon Walker | Personal Blog | Article | English |
| 24/08/2021 | [Add New Dependencies to Your Kedro Project](https://waylonwalker.com/kedro-new-dependencies/) | Waylon Walker | Personal Blog | Article | English |
| 24/08/2021 | [Running your Kedro Pipeline from the command line](https://waylonwalker.com/kedro-run/) | Waylon Walker | Personal Blog | Article | English |
| 23/08/2021 | [kedro Virtual Environment](https://waylonwalker.com/kedro-environment/) | Waylon Walker | Personal Blog | Article | English |
| 22/08/2021 | [Kedro Pipeline Create](https://waylonwalker.com/kedro-pipeline-create/) | Waylon Walker | Personal Blog | Article | English |
| 21/08/2021 | [Kedro Install](https://waylonwalker.com/kedro-install/) | Waylon Walker | Personal Blog | Article | English |
| 20/08/2021 | [Kedro Git Init](https://waylonwalker.com/kedro-git-init/) | Waylon Walker | Personal Blog | Article | English |
| 18/08/2021 | [Kedro New](https://waylonwalker.com/kedro-new/) | Waylon Walker | Personal Blog | Article | English |
| 17/08/2021 | [What is Kedro](https://waylonwalker.com/what-is-kedro/) | Waylon Walker | Personal Blog | Article | English |
| 16/08/2021 | [How I Kedro](https://waylonwalker.com/how-i-kedro/) | Waylon Walker | Personal Blog | Article | English |
| 07/08/2021 | [Incremental Versioned Datasets in Kedro](https://waylonwalker.com/kedro-incremental-versioned-datasets/) | Waylon Walker | Personal Blog | Article | English | |
| 16/07/2021 | [Productionizing ML Pipelines with Airflow, Kedro, and Great Expectations](https://airflowsummit.org/sessions/2021/productionizing-ml-pipelines-with-airflow-kedro-great-expectations/) | Kenten Danas | Airflow Summit | Recording | English | | -->
| 16/06/2021 | [Change Data Capture With Kedro and Dolt](https://www.dolthub.com/blog/2021-06-16-kedro-dolt-plugin/) | Oscar BatoriandMax Hoffman | dolthub | Article | English | |
| 20/04/2021 | [Applying data engineering to applications with Kedro](https://www.nearform.com/blog/applying-data-engineering-to-applications-with-kedro/) | Iñigo Sanz Garcia| NearForm Blog | Article | English | |
| 27/04/2021 | [Running Machine Learning Pipelines with Kedro, Kubeflow and Airflow](https://getindata.com/blog/running-machine-learning-pipelines-kedro-kubeflow-airflow/) | Mariusz Strzelecki | getindata Blog | Article | English | |
| 06/04/2021 | [PyConUS 20201 - Reproducible and maintainable data science code with Kedro](https://www.youtube.com/watch?v=JLTYNPoK7nw) | Yetunde Dada | YouTube | Recording | English | |
| 03/02/2021 | [Introducing Kedro: Yetunde Dada, Principal Product Manager at QuantumBlack](https://mattturck.com/kedro/) | Matt Turk | Personal Blog | Article | English | |
| N/A | [DataEngineerOne Kedro Youtube channel](https://youtube.com/c/DataEngineerOne) | Tam-Sanh Nguyen | YouTube | Recording | English | |
| 23/12/2020 | [Standardization of End-to-End Data Pipeline for AI Project Using Kedro](https://www.lftechnology.com/blog/ai-pipeline-kedro/)| Anish Pandey, Sushil Ghimire | leapfrog Blog | Article | English |
| 08/12/2020 | [Using Kedro pipelines to train Amazon SageMaker models](https://aws.amazon.com/blogs/opensource/using-kedro-pipelines-to-train-amazon-sagemaker-models/)| Jeremy Warrick | AWS Blog | Article | English |
| 06/11/2020 | [Kedro 6 Months In](https://lou.dev/blog/2020/kedro/) | Lou Kratz | Personal Blog | Article | English | |
| 27/10/2020 | [Jungle Scout case study: Kedro, Airflow, and MLFlow use on production code](https://junglescouteng.medium.com/jungle-scout-case-study-kedro-airflow-and-mlflow-use-on-production-code-150d7231d42e) | Eduardo Ohe | Jungle Scout Engineering | Article | English | |
| 26/10/2020 | [What's New in Kedro 0.16.6?](https://dev.to/waylonwalker/what-s-new-in-kedro-0-16-6-397f) | Waylon Walker | Personal Blog | Article | English | |
| 08/24/2020 | [Building a Production-Level Data Pipeline Using Kedro](https://opendatascience.com/building-a-production-level-data-pipeline-using-kedro/) | Kiyoshito Kunii | Open Data Science Blog | Article | English | |
| 08/10/2020 | [Designing a "Router" for kedro](https://waylonwalker.com/blog/designing-kedro-router) | Waylon Walker | Personal Blog | Article | English | |
| 06/10/2020 | [Power is nothing without control](https://towardsdatascience.com/power-is-nothing-without-control-aa43523745b6) | Jo Stichbury | Towards Data Science | Article | English | |
| 28/08/2020 | [Start small and grow big MLOps2020](https://speakerdeck.com/chck/sok-xiao-sakushi-meteda-kikuyu-terumlops2020) | @chck | PyCon Japan 2020 | Presentation | Japanese | |
| 22/07/2020 | [Principled Data Science Workflows](https://youtu.be/Dx2vG6qmtPs) | Eric Ma | PyData Data Boston July | Recording | English | |
| 21/07/2020 | [Get Started with Machine Learning Pipelines at Kedro](https://qiita.com/noko_qii/items/2395d3a3dbcd9410e5e7) | @noko_qii | Qiita | Article | Japanese | |
| 02/07/2020 | [Mid Meet Py - Ep.14 - Interview with Waylon Walker](https://dev.to/midmeetpy/mid-meet-py-ep-14-interview-with-waylon-walker-2h01) | Waylon Walker | DEV Community | Article | English | |
| 25/06/2020 | [How to find datasets in your kedro catalog](https://dev.to/waylonwalker/how-to-find-datasets-in-your-kedro-catalog-5a4b) | Waylon Walker | DEV Community | Article | English | |
| 19/06/2020 | [How Kedro handles your inputs](https://dev.to/waylonwalker/how-kedro-handles-your-inputs-162i) | Waylon Walker | DEV Community | Article | English | |
| 05/06/2020 | [Post mortem debugging sessions with Kedro hooks ](https://zainp.com/kedro-debugging-hooks/) | Zain Patel | Personal Blog | Article | English | |
| 01/06/2020 | [Start small and grow big MLOps2020](https://cyberagent.ai/blog/research/12898/) | @chck | CyberAgent AI tech studio | Article | Japanese | |
| 27/05/2020 | [Create Configurable Kedro Hooks](https://dev.to/waylonwalker/create-configurable-kedro-hooks-4k34) | Waylon Walker | DEV Community | Article | English | |
| 26/05/2020 | [What's an example use case of Kedro?](https://www.softwaredaily.com/topic/kedro/question/5ecd36859f3c7b002d7dc16f) | Waylon Walker | Software Daily | Article | English | |
| 26/05/2020 | [Kedro 0.16.0 is released ](https://www.softwaredaily.com/topic/kedro/question/5ecd420c9f3c7b002d7dc17c) | Waylon Walker | Software Daily | Article | English | |
| 20/05/2020 | [Make Notebook Pipeline with Kedro+Papermill ](https://qiita.com//hrappuccino/items/584c22c3cd5a2f0247d8) | Takumi Hirata | Qitta | Article | Japanese | |
| 14/05/2020 | [25 Hot New Data Tools and What They DON’T do](https://towardsdatascience.com/25-hot-new-data-tools-and-what-they-dont-do-31bf23bd8e56) | Pete Soderling | Towards Data Science | Article | English | |
| 11/05/2020 | [Kedro Hooks Intro - creating the kedro-preflight hook](https://dev.to/waylonwalker/creating-the-kedro-preflight-hook-29f2) | Waylon Walker | DEV Community | Article | English | |
| 19/04/2020 | [Next Generation Data Science and Data Engineering Frameworks](https://medium.com/@will_flwrs/python-data-engineering-tools-the-next-generation-354e00f2f060) | Will Flowers | Personal Blog | Article | English | |
| 02/03/2020 | [Create New Kedro Pipeline (kedro new)](https://dev.to/waylonwalker/create-new-kedro-pipeline-5dcd) | Waylon Walker | DEV Community | Article | English | |
| 24/02/2020 | [What is Kedro (The Parts)](https://dev.to/waylonwalker/what-is-kedro-lob) | Waylon Walker | DEV Community | Article | English | |
| 10/02/2020 | [Understanding best-practice Python tooling by comparing popular project templates](https://medium.com/@jonas.r.kemper/understanding-best-practice-python-tooling-by-comparing-popular-project-templates-6eba49229106) | Jonas Kemper | Medium | Article | English | |
| 08/02/2020 | [A story using the Kedro pipeline library ](http://socinuit.hatenablog.com/entry/2020/02/08/210423) | Kien Y. Knot | Hatena Blog | Article | Japanese | |
| 07/02/2020 | [Transparent data flow with Kedro](https://medium.com/@mapmeld/transparent-data-flow-with-kedro-eba842de4eb2) | Nick Doiron | Medium | Article | English |
| 02/02/2020 | [Comparison of Python pipeline packages: Airflow, Luigi, Metaflow, Kedro & PipelineX](https://medium.com/@Minyus86/comparison-of-pipeline-workflow-packages-airflow-luigi-gokart-metaflow-kedro-pipelinex-5daf57c17e7) | Yusuke Minami | Medium | Article | Japanese |
| 23/12/2019 | [Kedro in Jupyter Notebooks On Google GCP Dataproc](https://medium.com/@zhongchen/kedro-in-jupyter-notebooks-on-google-gcp-dataproc-31d5f45ad235) | Zhong Chen | Zhong Chen | Article | English |
| 19/12/2019 | [Production-level data pipelines that make everyone happy using Kedro](https://youtu.be/OFObles2CJs) | Yetunde Dada | PyData Berlin 2019 | Recording | English |
| 18/12/2019 | [Building a Pipeline with Kedro for an ML Competition](https://medium.com/mhiro2/building-pipeline-with-kedro-for-ml-competition-63e1db42d179) | Masaaki Hirotsu | Medium | Article | Japanese |
| 18/12/2019 | [Kedro - Nubank ML Meetup](https://youtu.be/clBgxmDsSjI) | Carlos Barreto | Nubank On the Stage | Recording | Portuguese |
| 16/12/2019 | [Data Science Best Practices con Kedro](https://youtu.be/_0kMmRfltE) | Carlos Gimenez | PyData Córdoba Argentina 2019 | Recording | Spanish |
| 18/11/2019 | [Using Kedro and MLflow Deploying and versioning data pipelines at scale](https://medium.com/@QuantumBlack/deploying-and-versioning-data-pipelines-at-scale-942b1d81b5f5) | Tom Goldenberg & Musa Bilal | QuantumBlack Medium | Article | English |
| 01/10/2019 | [Ship Faster With An Opinionated Data Pipeline Framework Episode** 100](https://www.dataengineeringpodcast.com/kedro-data-pipeline-episode-100/) | Tom Goldenberg | Data Engineering Podcast | Podcast | English |
| 11/07/2019 | [Some cool open-source Python packages for Machine Learning](https://aetperf.github.io/2019/07/11/Some-cool-open-source-Python-packages-for-Machine-Learning.html) | François Pacul | Architecture & Performance | Article | English |
| 04/06/2019 | [Kedro: A New Tool For Data Science ](https://towardsdatascience.com/kedro-prepare-to-pimp-your-pipeline-f8f68c263466) | Jo Stichbury | Towards Data Science | Article | English |
| 23/12/2020 | [Standardization of End-to-End Data Pipeline for AI Project Using Kedro ](https://www.lftechnology.com/blog/ai-pipeline-kedro/) | Anish Pandey & Sushil Ghimire | Industrial use case | Article | English |## Where can I find plugins, extensions, and `kedro`-related packages?
The community of plugin authors tag each project on GitHub with the [`kedro-plugin`](https://github.com/topics/kedro-plugin) tag. You can find a listing of all plugins on GitHub.
## What licence do you use?
Kedro is licensed under the [Apache 2.0](https://github.com/kedro-org/kedro/blob/main/LICENSE.md) License.