https://github.com/nasa-pds/kdp

KDP Does Pipelines
https://github.com/nasa-pds/kdp

Last synced: over 1 year ago
JSON representation

KDP Does Pipelines

• Host: GitHub
• URL: https://github.com/nasa-pds/kdp
• Owner: NASA-PDS
• License: apache-2.0
• Created: 2021-06-14T21:30:05.000Z (about 5 years ago)
• Default Branch: main
• Last Pushed: 2023-05-23T00:48:12.000Z (about 3 years ago)
• Last Synced: 2025-04-01T20:32:28.771Z (over 1 year ago)
• Language: Python
• Homepage:
• Size: 204 KB
• Stars: 6
• Watchers: 4
• Forks: 3
• Open Issues: 16
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE.txt
  • Security: SECURITY.md

Awesome Lists containing this project

README

          
# KDP: Kubernetes does pipelines

KDP is a framework that makes it simple to orchestrate highly performant data processing pipelines. We say *orchestrate* with purpose: KDP leverages the Kubernetes [operator pattern](https://kubernetes.io/docs/concepts/extend-kubernetes/operator/) to create a custom extension of the Kubernetes API. This means that KDP benefits from the advantages of Kubernetes, and that it doesn't actually have to deal with conainer orchestration, lifecycle management, concurrency, etc. That's all up to Kubernetes, and we like it that way.

# Getting Started

KDP has a lot of moving parts, so it will be useful to outline some key concepts that will come up a lot:

TODO: more docs