https://github.com/kserve/kserve

Standardized Serverless ML Inference Platform on Kubernetes

artificial-intelligence genai hacktoberfest istio k8s knative kserve kubeflow kubernetes llm-inference machine-learning mlops model-interpretability model-serving pytorch service-mesh sklearn tensorflow xgboost

Last synced: 13 May 2025

https://github.com/logicalclocks/hopsworks

Hopsworks - Data-Intensive AI platform with a Feature Store

aws azure data-science feature-engineering feature-management feature-store gcp governance hopsworks kserve machine-learning ml mlops model-serving pyspark python serverless

Last synced: 14 May 2025

https://github.com/treebeardtech/kubeflow-bootstrap

🪐 1-click Kubeflow using ArgoCD

ai airflow argocd dask gpu helm jupyter jupyterhub jupyterlab kserve kubeflow kubernetes kustomize llms machine-learning mlflow ray spark terraform

Last synced: 08 May 2025

https://github.com/dudeperf3ct/model-deployment

Deploying machine learning model using 10+ different deployment tools

bentoml fastapi kserve kubernetes mlops mlserver rayserve seldon serverless-framework

Last synced: 15 Apr 2025

https://github.com/stefanolusardi/tiny_inference_engine

Client/Server system to perform distributed inference on high load systems.

ai cmake conan cpp deep-neural-networks docker grpc inference-client inference-engine inference-server kserve onnxruntime

Last synced: 23 Apr 2025

https://github.com/bakdata/kafka-streams-kserve-demo

A demo to accompany our blogpost "Scalable Machine Learning with Kafka Streams and KServe"

kafka kafka-streams kserve kubeflow kubernetes

Last synced: 10 Apr 2025

https://github.com/teiacare/teiacareinferenceclient

TeiaCareInferenceClient is a C++ inference client library that implements KServe protocol.

cpp cross-platform deep-learning grpc inference kserve machine-learning

Last synced: 12 Apr 2025

https://github.com/satyajitghana/kserve-inference-graph

KServe Inference Graph Example

inference-graph k8s kserve kuberentes pytorch

Last synced: 16 May 2025

https://github.com/syedshameersarwar/mlopslifecycle

grafana kserve kubeflow mlflow mlops monitoring scikit-learn

Last synced: 19 Feb 2025

https://github.com/ajithvcoder/emlo4-session-17-ajithvcoder-canary-argocd-kserve

Refer https://github.com/ajithvcoder/emlo4-session-17-ajithvcoder for complete deployment guide The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs

argocd aws-eks canary-deployment image-classification kserve kubernetes

Last synced: 05 Apr 2025

https://github.com/zabtas/fastapi-helm-chart

This repository contains a Helm chart for a FastAPI application to be deployed on OpenShift clusters with minimal effort with customizable configurations.

ansible devops dive-to-argo fastapi helm-chart kserve kubernetes-deployment load-balancer lxc-containers machine-learning minikube openshift postgresql redis

Last synced: 03 Mar 2025