{"id":19745662,"url":"https://github.com/kubeflow/kfp-tekton","last_synced_at":"2025-04-11T11:48:53.887Z","repository":{"id":35392424,"uuid":"217148415","full_name":"kubeflow/kfp-tekton","owner":"kubeflow","description":"Kubeflow Pipelines on Tekton","archived":false,"fork":false,"pushed_at":"2024-11-19T12:23:51.000Z","size":81909,"stargazers_count":179,"open_issues_count":78,"forks_count":124,"subscribers_count":14,"default_branch":"master","last_synced_at":"2025-04-01T17:59:23.790Z","etag":null,"topics":["dsl","hacktoberfest","kubeflow","kubeflow-pipeline","mlops","python","tekton","tekton-pipelines"],"latest_commit_sha":null,"homepage":"https://developer.ibm.com/blogs/kubeflow-pipelines-with-tekton-and-watson/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kubeflow.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-10-23T20:33:01.000Z","updated_at":"2025-03-21T07:55:43.000Z","dependencies_parsed_at":"2023-12-26T16:32:39.939Z","dependency_job_id":"9ec1ff35-f60d-4320-bd65-8d16620347f8","html_url":"https://github.com/kubeflow/kfp-tekton","commit_stats":{"total_commits":704,"total_committers":41,"mean_commits":"17.170731707317074","dds":0.5681818181818181,"last_synced_commit":"2d7cc156d131c66c9274a6c62a4235e3d575a88b"},"previous_names":[],"tags_count":51,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubeflow%2Fkfp-tekton","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubeflow%2Fkfp-tekton/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubeflow%2Fkfp-tekton/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubeflow%2Fkfp-tekton/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kubeflow","download_url":"https://codeload.github.com/kubeflow/kfp-tekton/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248388859,"owners_count":21095473,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dsl","hacktoberfest","kubeflow","kubeflow-pipeline","mlops","python","tekton","tekton-pipelines"],"created_at":"2024-11-12T02:10:46.555Z","updated_at":"2025-04-11T11:48:53.866Z","avatar_url":"https://github.com/kubeflow.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Kubeflow Pipelines on Tekton\n\nProject bringing Kubeflow Pipelines and Tekton together. The project is driven\naccording to this [design doc](http://bit.ly/kfp-tekton). The current code allows you run Kubeflow Pipelines with Tekton backend end to end.\n\n* Create your Pipeline using Kubeflow Pipelines DSL, and compile it to Tekton\n  YAML.\n* Upload the compiled Tekton YAML to KFP engine (API and UI), and run end to end\n  with logging and artifacts tracking enabled.\n* In KFP-Tekton V2, the SDK compiler will generate the same intermediate representation as in the main Kubeflow pipelines SDK. All the Tekton related implementations are all embedded into the V2 backend API service.\n\nFor more details about the project please follow this detailed [blog post](https://developer.ibm.com/blogs/awb-tekton-optimizations-for-kubeflow-pipelines-2-0) . For the latest KFP-Tekton V2 implementation and [supported offerings](https://developer.ibm.com/articles/advance-machine-learning-workflows-with-ibm-watson-pipelines/), please follow our latest [Kubecon Talk](https://www.youtube.com/watch?v=ecx-yp4g7YU) and [slides](https://docs.google.com/presentation/d/1Su42ApXzZvVwhNSYRAk3bd0heHOtrdEX/edit?usp=sharing\u0026ouid=103716780892927252554\u0026rtpof=true\u0026sd=true). For information on the KFP-Tekton V1 implementation, look at these [slides](https://www.slideshare.net/AnimeshSingh/kubeflow-pipelines-with-tekton-236769976) as well as this [deep dive presentation](https://www.youtube.com/watch?v=AYIeNtXLT_k) for demos.\n\n## Architecture\n\nWe are currently using [Kubeflow Pipelines 1.8.4](https://github.com/kubeflow/pipelines/releases/tag/1.8.4) and\n[Tekton \u003e= 0.53.2](https://github.com/tektoncd/pipeline/releases/tag/v0.53.2)\nin the master branch for this project.\n\nFor [Kubeflow Pipelines 2.0.5](https://github.com/kubeflow/pipelines/releases/tag/2.0.5) and\n[Tekton \u003e= 0.53.2](https://github.com/tektoncd/pipeline/releases/tag/v0.53.2)\nintegration, please check out the [kfp-tekton v2-integration](https://github.com/kubeflow/kfp-tekton/tree/v2-integration) branch and [KFP-Tekton V2 deployment](/guides/kfp_tekton_install.md#standalone-kubeflow-pipelines-v2-with-tekton-backend-deployment) instead.\n\n![kfp-tekton](images/kfp-tekton.png)\n\n\nKubeflow Pipelines is a platform for building and deploying portable, scalable machine learning (ML) workflows. More architectural details about the Kubeflow Pipelines can be found on the [Kubeflow website](https://www.kubeflow.org/docs/components/pipelines/overview/).\n\nThe Tekton Pipelines project provides Kubernetes-style resources for declaring\nCI/CD-style pipelines. Tekton introduces several [Custom Resource Definitions](https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/)(CRDs) including Task, Pipeline, TaskRun, and PipelineRun. A PipelineRun represents a single running instance of a Pipeline and is responsible for creating a Pod for each of its Tasks and as many containers within each Pod as it has Steps. Please look for more details in the [Tekton repo](https://github.com/tektoncd/pipeline).\n\n### Get Started using Kubeflow Pipelines on Tekton\n\n[Install Kubeflow Pipelines with Tekton backend](/guides/kfp_tekton_install.md)\n\n[KFP Tekton Pipelines User Guide](/guides/kfp-user-guide/README.md)\n\n[Use KFP Tekton SDK](/sdk/README.md)\n\n[Run Samples](/samples/README.md)\n\n[Available KFP DSL Features](/sdk/FEATURES.md)\n\n[Tekton Specific Features](/guides/advanced_user_guide.md)\n\n### Development Guides\n\n[Backend Developer Guide](/guides/developer_guide.md)\n\n[SDK Developer Guide](/sdk/python/README.md)\n\n[Compilation Tests Status Report](/sdk/python/tests/README.md)\n\n### Design Guides\n\n[Design Doc](http://bit.ly/kfp-tekton)\n\n[KFP, Argo and Tekton Features Comparison](https://docs.google.com/spreadsheets/d/1LFUy86MhVrU2cRhXNsDU-OBzB4BlkT9C0ASD3hoXqpo/edit#gid=979402121)\n\n### Community\n\n[Kubeflow Slack](https://join.slack.com/t/kubeflow/shared_invite/zt-cpr020z4-PfcAue_2nw67~iIDy7maAQ)\n\n### References\n\n[Kubeflow and TFX Pipelines](/samples/kfp-tfx)\n\n[Kubeflow and TFX Pipelines talk at Tensorflow World](https://www.slideshare.net/AnimeshSingh/hybrid-cloud-kubeflow-and-tensorflow-extended-tfx)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkubeflow%2Fkfp-tekton","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkubeflow%2Fkfp-tekton","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkubeflow%2Fkfp-tekton/lists"}