https://github.com/polyaxon/mloperator

Machine learning operator & controller for Kubernetes
https://github.com/polyaxon/mloperator

dask deep-learning k8s keras kubernetes kubernetes-operator machine-learning mlops mpi mxnet notebook pytorch scikit-learn spark tensorboard tensorflow xgboost

Last synced: 3 months ago
JSON representation

Machine learning operator & controller for Kubernetes

• Host: GitHub
• URL: https://github.com/polyaxon/mloperator
• Owner: polyaxon
• License: apache-2.0
• Created: 2018-09-13T09:07:00.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2024-09-02T21:04:11.000Z (9 months ago)
• Last Synced: 2025-02-24T18:49:38.761Z (3 months ago)
• Topics: dask, deep-learning, k8s, keras, kubernetes, kubernetes-operator, machine-learning, mlops, mpi, mxnet, notebook, pytorch, scikit-learn, spark, tensorboard, tensorflow, xgboost
• Language: Go
• Homepage: https://polyaxon.com
• Size: 2.1 MB
• Stars: 92
• Watchers: 4
• Forks: 8
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

        
[![License: Apache 2](https://img.shields.io/badge/License-apache2-green.svg)](LICENSE)

[![mloperator](https://github.com/polyaxon/mloperator/actions/workflows/tests.yml/badge.svg)](https://github.com/polyaxon/mloperator/actions/workflows/tests.yml)

[![Slack](https://img.shields.io/badge/chat-on%20slack-aadada.svg?logo=slack&longCache=true)](https://polyaxon.com/slack/)

[![Docs](https://img.shields.io/badge/docs-stable-brightgreen.svg?style=flat)](https://polyaxon.com/docs/)

[![GitHub](https://img.shields.io/badge/issue_tracker-github-blue?logo=github)](https://github.com/polyaxon/polyaxon/issues)

[![GitHub](https://img.shields.io/badge/roadmap-github-blue?logo=github)](https://github.com/polyaxon/polyaxon/milestones)






  


    

  





# Machine Learning Operator & Controller for Kubernetes

## Introduction

Kubernetes offers the facility of extending it's API through the concept of 'Operators' ([Introducing Operators: Putting Operational Knowledge into Software](https://coreos.com/blog/introducing-operators.html)). This repository contains the resources and code to deploy an Polyaxon native CRDs using a native Operator for Kubernetes.

This project is a Kubernetes controller that manages and watches Customer Resource Definitions (CRDs) that define primitives to handle, operate and reconcile operations like: builds, jobs, experiments, distributed training, notebooks, tensorboards, kubeflow integrations, ...

![MLOperator Architecture](./artifacts/MLOperator-architecture.png)

## Kubeflow, Ray, and Dask operators

This Operator extends natively [Kubeflow-Operators](https://github.com/polyaxon/training-operator) (TFJob/PytorchJob/MXNet/XGBoost/MPI/Paddle), Dask Operator, Ray Operator.