Projects in Awesome Lists tagged with kubeflow

https://github.com/kubeflow/kubeflow

Machine Learning Toolkit for Kubernetes

google-kubernetes-engine jupyter kubeflow kubernetes machine-learning minikube ml notebook tensorflow

Last synced: 16 Dec 2024

https://github.com/alirezadir/production-level-deep-learning

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

ai artificial-intelligence deep-learning deployment kubeflow machine-learning pipeline practical-machine-learning production-system scalable-applications system-design tfx

Last synced: 04 Dec 2024

https://github.com/alirezadir/Production-Level-Deep-Learning

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

ai artificial-intelligence deep-learning deployment kubeflow machine-learning pipeline practical-machine-learning production-system scalable-applications system-design tfx

Last synced: 08 Nov 2024

https://github.com/PipelineAI/pipeline

PipelineAI

airflow artificial-intelligence cassandra docker gpu kafka keras kubeflow kubernetes machine-learning neural-network pipelineai pytorch redis scikit-learn spark tensorflow tfx

Last synced: 30 Oct 2024

https://github.com/pipelineai/pipeline

PipelineAI

airflow artificial-intelligence cassandra docker gpu kafka keras kubeflow kubernetes machine-learning neural-network pipelineai pytorch redis scikit-learn spark tensorflow tfx

Last synced: 19 Dec 2024

https://github.com/fluxcapacitor/pipeline

PipelineAI

airflow artificial-intelligence cassandra docker gpu kafka keras kubeflow kubernetes machine-learning neural-network pipelineai pytorch redis scikit-learn spark tensorflow tfx

Last synced: 06 Sep 2024

https://github.com/tencentmusic/cube-studio

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式

ai aihub argo automl gpt inference kubeflow kubernetes llmops mlops notebook pipeline pytorch spark vgpu workflow

Last synced: 17 Dec 2024

https://github.com/kubeflow/pipelines

Machine Learning Pipelines for Kubeflow

data-science kubeflow kubeflow-pipelines kubernetes machine-learning mlops pipeline

Last synced: 16 Dec 2024

https://github.com/kserve/kserve

Standardized Serverless ML Inference Platform on Kubernetes

artificial-intelligence genai hacktoberfest istio k8s knative kserve kubeflow kubernetes llm-inference machine-learning mlops model-interpretability model-serving pytorch service-mesh sklearn tensorflow xgboost

Last synced: 16 Dec 2024

https://github.com/elyra-ai/elyra

Elyra extends JupyterLab with an AI centric approach.

ai airflow anaconda apache-airflow binder docker elyra hacktoberfest jupyterlab jupyterlab-extension jupyterlab-extensions jupyterlab-notebooks kubeflow kubeflow-pipelines machine-learning notebook-jupyter notebooks pipelines pypi python

Last synced: 17 Dec 2024

https://github.com/kubeflow/training-operator

Distributed ML Training and Fine-Tuning on Kubernetes

ai distributed fine-tuning gpu huggingface jax kubeflow kubernetes llm machine-learning mlops python pytorch tensorflow xgboost

Last synced: 19 Dec 2024

https://github.com/kubeflow/katib

Automated Machine Learning on Kubernetes

ai automl huggingface hyperparameter-tuning jax kubeflow kubernetes llm machine-learning mlops neural-architecture-search pytorch scikit-learn tensorflow

Last synced: 17 Dec 2024

https://github.com/couler-proj/couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

apache-airflow argo-workflows cloud-native distributed-computing kubeflow kubernetes machine-learning python scheduler tekton-pipelines unified-api unified-interface workflow-automation workflow-engine workflow-management

Last synced: 04 Nov 2024

https://github.com/kubeflow/arena

A CLI for Kubeflow.

deep-learning docker kubeflow kubernetes tensorflow

Last synced: 13 Nov 2024

https://github.com/kubeflow-kale/kale

Kubeflow’s superfood for Data Scientists

jupyter-notebook kubeflow kubeflow-pipelines machine-learning

Last synced: 21 Dec 2024

https://github.com/awslabs/data-on-eks

DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS

aws-eks eks jupyterhub kubeflow kubernetes ml mlflow ray spark terraform

Last synced: 08 Nov 2024

https://github.com/kubeflow/mpi-operator

Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)

apache-mxnet distributed-computing horovod kubeflow kubernetes mpi pytorch tensorflow

Last synced: 19 Dec 2024

https://github.com/terrytangyuan/distributed-ml-patterns

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

argo argo-workflows book cloud-computing cloud-native data-science devops distributed-machine-learning distributed-systems kubeflow kubernetes large-scale-machine-learning machine-learning machine-learning-pipelines manning-publications mlops python tensorflow

Last synced: 15 Dec 2024

https://github.com/thoughtworks/mlops-platforms

Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...

azureml data-science databricks dataiku datarobot google-ai-platform h2oai iguazio knime kubeflow machine-learning mlflow mlops pachyderm sagemaker seldon

Last synced: 12 Nov 2024

https://github.com/azure/kubeflow-labs

👩‍🔬 Train and Serve TensorFlow Models at Scale with Kubernetes and Kubeflow on Azure

distributed-tensorflow docker jupyter-notebook jupyterhub kubeflow kubernetes machine-learning tensorflow tensorflow-serving

Last synced: 30 Sep 2024

https://github.com/deployKF/deployKF

deployKF builds machine learning platforms on Kubernetes. We combine the best of Kubeflow, Airflow†, and MLflow† into a complete platform.

argocd artificial-intelligence gitops kubeflow kubernetes machine-learning mlops

Last synced: 13 Nov 2024

https://github.com/helmut-hoffer-von-ankershoffen/jetson

Helmut Hoffer von Ankershoffen experimenting with arm64 based NVIDIA Jetson (Nano and AGX Xavier) edge devices running Kubernetes (K8s) for machine learning (ML) including Jupyter Notebooks, TensorFlow Training and TensorFlow Serving using CUDA for smart IoT.

ansible archiconda cuda docker edge-devices hoffer-von-ankershoffen jupyter k8s kubeflow kubernetes kustomize machine-learning ml nvidia-jetson-nano nvidia-jetson-xavier skaffold smart-iot software-engineering tensorflow-serving virtualbox

Last synced: 31 Oct 2024

https://github.com/mikeroyal/kubernetes-guide

Kubernetes Guide. Learn all about Kubernetes monitoring, networking, and containers. Whether you're running Kubernetes Locally or in the Cloud ( Azure, AWS, and GCP).

awesome-lists cloud-computing gke istio k3s k8s kubeadm kubectl kubeflow kubernetes kubernetes-cluster kubernetes-controller kubernetes-deployment kubernetes-monitoring kubernetes-operator kubernetes-setup minikube rancher thanos wsl2

Last synced: 18 Dec 2024

https://github.com/mikeroyal/Kubernetes-Guide

Kubernetes Guide. Learn all about Kubernetes monitoring, networking, and containers. Whether you're running Kubernetes Locally or in the Cloud ( Azure, AWS, and GCP).

awesome-lists cloud-computing gke istio k3s k8s kubeadm kubectl kubeflow kubernetes kubernetes-cluster kubernetes-controller kubernetes-deployment kubernetes-monitoring kubernetes-operator kubernetes-setup minikube rancher thanos wsl2

Last synced: 05 Nov 2024

https://github.com/kubeflow/kfp-tekton

Kubeflow Pipelines on Tekton

dsl hacktoberfest kubeflow kubeflow-pipeline mlops python tekton tekton-pipelines

Last synced: 20 Dec 2024

https://github.com/raptor-ml/raptor

Transform your pythonic research to an artifact that engineers can deploy easily.

ai-infra data-engineering data-science dataops feature-engineering feature-extraction feature-platform featurestore kubeflow kubernetes machine-learning ml mlops model-deployment production raptor raptor-ml reactive-ml

Last synced: 17 Dec 2024

https://github.com/alauda/kubeflow-chart

Kubeflow helm chart

hacktoberfest helm-charts kubeflow kubernetes mlops

Last synced: 06 Nov 2024

https://github.com/kf5i/k3ai

K3ai is a lightweight, fully automated, AI infrastructure-in-a-box solution that allows anyone to experiment quickly with Kubeflow pipelines. K3ai is perfect for anything from Edge to laptops.

artificial-intelligence datascience edge inference-server k3s kubeflow kubeflow-pipelines kubernetes machinelearning

Last synced: 21 Nov 2024

https://github.com/google-aai/tf-serving-k8s-tutorial

A Tutorial for Serving Tensorflow Models using Kubernetes

docker-image google-cloud keras-tensorflow kubeflow kubeflow-community kubernetes tensorflow-api tensorflow-serving tensorflow-tutorials

Last synced: 16 Dec 2024

https://github.com/omerbsezer/fast-kubeflow

This repo covers Kubeflow Environment with LABs: Kubeflow GUI, Jupyter Notebooks on pods, Kubeflow Pipelines, Experiments, KALE, KATIB (AutoML: Hyperparameter Tuning), KFServe (Model Serving), Training Operators (Distributed Training), Projects, etc.

automl distributed-training jupyter-notebooks kale katib kubeflow kubeflow-component kubeflow-demo kubeflow-pipeline kubernetes training-operators

Last synced: 11 Nov 2024

https://github.com/caicloud/ciao

Kernel for Kubeflow in Jupyter Notebook

clever jupyter jupyter-kernel kubeflow

Last synced: 02 Nov 2024

https://github.com/polyaxon/polyaxon-examples

Code for tutorials and examples

deep-learning deeplearning horovod jupyter-notebook keras kubeflow kubernetes machine-learning mlops mpi mpijob mxnet nerual-network polyaxon pytorch pytorchjob scikit-learn tensorflow tfjob

Last synced: 22 Nov 2024

https://github.com/provectus/sak-kubeflow

🚀 Deploy Kubeflow on AWS EKS with Terraform 🤖

ai argocd artificial-intelligence automation aws cluster data-science deep-learning devops eks gitops iac infrastructure infrastructure-as-code kubeflow machine-learning ml open-source terraform

Last synced: 08 Nov 2024

https://github.com/kubeflow/code-intelligence

ML-Powered Developer Tools, using Kubeflow

deep-learning fastai flask kubeflow kubernetes machine-learning natural-language-processing nlp pytorch rest-api

Last synced: 29 Sep 2024

https://github.com/ritazh/k8s-ml

🎱 A demonstration of existing machine learning toolkits on Kubernetes

argo azure-container-instances azure-kubernetes-service inceptionv3 kubeflow kubernetes machine-learning tensorflow

Last synced: 19 Dec 2024

https://github.com/getindata/kedro-kubeflow

Kedro Plugin to support running workflows on Kubeflow Pipelines

ai-pipelines kedro kedro-kubeflow kedro-plugin kubeflow kubeflow-pipelines machinelearning mlops

Last synced: 21 Dec 2024

https://github.com/ploomber/soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.

airflow argo argo-workflows aws data-science kubeflow kubeflow-pipelines kubernetes machine-learning slurm workflow

Last synced: 19 Dec 2024

https://github.com/google/nitroml

NitroML is a modular, portable, and scalable model-quality benchmarking framework for Machine Learning and Automated Machine Learning (AutoML) pipelines.

automl benchmarking kubeflow machine-learning model-quality modular portable python scale tfx

Last synced: 30 Oct 2024

https://github.com/graykode/aws-kubeflow

A guideline for basic use and installation of kubeflow in AWS.

aws eks kubeflow kubernetes ml-cloud

Last synced: 22 Oct 2024

https://github.com/sayakpaul/dual-deployments-on-vertex-ai

Project demonstrating dual model deployment scenarios using Vertex AI (GCP).

automl gcp keras kubeflow mlops tensorflow tfx vertex-ai

Last synced: 22 Oct 2024

https://github.com/lightbend/kubeflow-recommender

Kubeflow example of machine learning/model serving

kubeflow machine-learning model-serving

Last synced: 12 Nov 2024

https://github.com/saschagrunert/kubeflow-data-science-on-steroids

The blog post about Kubeflow, including all materials

blog blog-post cloud-native data-science datascience kubeflow kubernetes talk

Last synced: 27 Oct 2024

https://github.com/wbuchwalter/fairing

👩‍🔬[Experimental] Easily train and serve ML models on Kubernetes, directly from your python code.

kubeflow kubernetes machine-learning

Last synced: 05 Nov 2024

https://github.com/pythondeveloper6/awesome-mlops

All the available resources to master MLOPS from scratch

automl aws-sagemaker azure-ml bentoml dagshub django docker dvc fastapi git gradio kubeflow mlflow mlops pycaret shape streamlit zenml

Last synced: 18 Nov 2024

https://github.com/solygambas/mlops-projects

Hands-on MLOps projects to explore and learn the practical aspects of machine learning engineering for production.

docker fastapi google-cloud google-cloud-platform huggingface huggingface-transformers keras kubectl kubeflow kubernetes machine-learning mlops python scikit-learn tensorflow

Last synced: 27 Oct 2024

https://github.com/statcan/aaw-kubeflow-containers

Containers built to be used with Kubeflow for Data Science

aaw containers daaas kubeflow kubernetes

Last synced: 05 Dec 2024

https://github.com/e2fyi/kubeflow-aws

Kustomize manifest to deploy kubeflow pipelines in AWS

aws kubeflow kubeflow-pipelines kustomize

Last synced: 16 Nov 2024

https://github.com/kairen/kourse

A collection of container tutorials that gets you on-boarded to CONTAINER WORLD!

k8s-course kubeflow kubernetes

Last synced: 30 Oct 2024

https://github.com/dermatologist/kedro-multimodal

Template for multi-modal machine learning in healthcare using Kedro. Combine reports, tabular data and images using various fusion methods.

healthcare jupyter kedro kubeflow machine-learning medical multi-modal pipeline vertex-ai

Last synced: 24 Oct 2024

https://github.com/treebeardtech/kubeflow-bootstrap

🪐 1-click Kubeflow using ArgoCD

ai airflow argocd dask gpu helm jupyter jupyterhub jupyterlab kserve kubeflow kubernetes kustomize llms machine-learning mlflow ray spark terraform

Last synced: 10 Nov 2024

https://github.com/ashishpatel26/kubeflow-installation-on-windows-10

Kubeflow installation on windows 10/11

deep-learning docker docker-setup kubeflow kubernetes machine-learning minikube minikube-cluster minikube-setup mlflow mlops

Last synced: 19 Nov 2024

https://github.com/statcan/aaw-kubeflow-mlops

Kubeflow MLOps pipeline using GitHub Actions

aaw daaas kubeflow kubernetes mlops

Last synced: 05 Dec 2024

https://github.com/statcan/jupyter-apis

A Golang replacement for the Kubeflow Jupyter Web APIs / Un remplacement Golang pour les API de Web de Jupyter, partie de Kubeflow

aaw daaas jupyter kubeflow kubernetes

Last synced: 05 Dec 2024

https://github.com/datastacktv/kubeflow-introduction

Code examples for the Introduction to Kubeflow course

kubeflow

Last synced: 09 Nov 2024

https://github.com/e2fyi/argo-models

Generated openapi models for argo

argo kubeflow openapi python swagger

Last synced: 16 Nov 2024

https://github.com/datarootsio/terraform-provider-kubeflowpipelines

Terraform provider for Kubeflow pipelines API

kubeflow kubeflow-pipelines terraform

Last synced: 14 Nov 2024

https://github.com/statcan/aaw-kubeflow-manifests

Kustomize installation manifests for Kubeflow

aaw daaas kubeflow kubernetes manifest

Last synced: 05 Dec 2024

https://github.com/googlecloudplatform/kubeflow-gke-docs

Documentation for Kubeflow on Google Cloud

documentation gcp gke google-cloud google-cloud-platform kubeflow kubeflow-cluster kubeflow-pipelines kubernetes machine-learning mlops pipelines

Last synced: 07 Oct 2024

https://github.com/gaocegege/kubeflow-weekly

Kubeflow weekly

kubeflow weekly

Last synced: 11 Dec 2024

https://github.com/statcan/aaw-kubeflow-profiles-controller

Profiles controller for the fine grained control of Kubeflow

aaw daaas kubeflow kubernetes

Last synced: 05 Dec 2024

https://github.com/zahidul-islam/60-days-of-data-engineering

The log of my 60 days of Data Engineering challenge - to keep myself accountable

60daysofdataengineering airflow apache-spark kafka kubeflow tensoflow

Last synced: 07 Nov 2024

https://github.com/e2fyi/kfx

Extensions to kubeflow pipeline sdk.

kfx kubeflow kubeflow-pipeline-task kubeflow-pipeline-ui kubeflow-pipelines python visualizations

Last synced: 16 Nov 2024

https://github.com/saidsef/kubeflow-on-k8s

Kubeflow running on Kubernetes - Machine Learning Toolkit for Kubernetes

kubeflow kubernetes machine-learning ml notebook-jupyter workflow-engine

Last synced: 14 Nov 2024

https://github.com/tbaums/konvoy-kudo-studio

kafka konvoy kubeflow kudo mnist zookeeper

Last synced: 18 Dec 2024

https://github.com/statcan/aaw-contrib-containers

Containers to be used for general purpose Data Science

aaw containers daaas kubeflow kubernetes

Last synced: 05 Dec 2024

https://github.com/haiker2011/kubecon-ml

整理kubecon关于机器学习相关的话题分享

kubecon kubeflow kubernetes machine-learning

Last synced: 12 Nov 2024

https://github.com/saschagrunert/kubeflow-notebook-gpu

Kubeflow GPU Notebook Container Image

container-image gpu kubeflow notebook tensorflow

Last synced: 07 Nov 2024

https://github.com/e2fyi/theia-controller

kubernetes CRD controller to manage theias (vscode alternative) - imagine jupyterhub.

controller-manager kubeflow kubernetes theia

Last synced: 16 Nov 2024

https://github.com/uhstray-io/open-k8s

Easy kubernetes deployments and guides from uhstray.io

artificial-intelligence automation bash devops golang k0s k0sctl kubeadm kubeflow kubernetes machine-learning microk8s shell yaml

Last synced: 08 Dec 2024

https://github.com/statcan/aaw-inferenceservices-controller

Inferenceservices controller for the fine grained control of KServe

aaw daaas kubeflow kubernetes

Last synced: 05 Dec 2024

https://github.com/andre-marcos-perez/ifood-mlops-readme

This repository is the docs of my solution for the iFood ML Engineer test.

aws kubeflow mlops

Last synced: 17 Dec 2024

https://github.com/dark-art108/mlops-with-wafer

Working with Mlops Tools like Mlflow,Kubeflow and others

ai airflow computer-vision dvc kubeflow machine-learning mlflow-tracking

Last synced: 12 Nov 2024

https://github.com/yingding/applyllm

A python package for applying LLM with LangChain and Hugging Face on local CUDA/MPS host

accelerator batch cuda framework inference kubeflow langchain llm mps pipeline slurm transformers

Last synced: 27 Oct 2024

https://github.com/alexeygrigorev/kfserving-keras-transformer

A transformer for KFServing that users keras_image_helper

deep-learning keras kfserving kubeflow

Last synced: 16 Nov 2024

https://github.com/statcan/aaw-kubeflow-opa-sync

Synchronize profile editors into the Open Policy Agent for use in MinIO Access Control / Synchronisation de données des éditeurs de profiles stockés dans Open Policy Agent, ceux-ci utilisés pour la contrôle d'accès à MinIO

aaw daaas kubeflow kubernetes open-policy-agent

Last synced: 05 Dec 2024