Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/noahgift/rust-mlops-template

A work in progress to build out solutions in Rust for MLOPs

cli dataframe hugging huggingface mlops polars pytorch rust web

Last synced: 03 Jul 2024

https://github.com/bosch-aisecurity-aishield/watchtower

AIShield Watchtower: Dive Deep into AI's Secrets! 🔍 Open-source tool by AIShield for AI model insights & vulnerability scans. Secure your AI supply chain today! ⚙️🛡️

adversarial-attacks aisec aisecurity mlops mlsecops security security-automation security-tools supply-chain vulnerability-scanners

Last synced: 02 Jul 2024

https://github.com/mlrun/mlrun

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

data-engineering data-science experiment-tracking kubernetes machine-learning mlops mlops-workflow model-serving python workflow

Last synced: 29 Jun 2024

https://github.com/ploomber/soorgeon

Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊

data-engineering data-science jupyter jupyter-notebooks machine-learning mlops workflow

Last synced: 29 Jun 2024

https://github.com/pytorch/serve

Serve, optimize and scale PyTorch models in production

cpu deep-learning docker gpu kubernetes machine-learning metrics mlops optimization pytorch serving

Last synced: 29 Jun 2024

https://github.com/caraml-dev/merlin

Kubernetes-friendly ML model management, deployment, and serving.

machine-learning mlops

Last synced: 29 Jun 2024

https://github.com/Oxid15/cascade

Lightweight and modular MLOps library targeted at small teams or individuals

deep-learning feature-selection machine-learning ml mlops model-lifecycle model-selection

Last synced: 29 Jun 2024

https://github.com/kevin-hanselman/dud

A lightweight CLI tool for versioning data alongside source code and building data pipelines.

data-engineering data-pipelines data-science dataset dvcs machine-learning mlops

Last synced: 29 Jun 2024

https://github.com/allegroai/clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

ai clearml control deep-learning deeplearning devops experiment experiment-manager k8s machine-learning machinelearning mlops trains trainsai version version-control

Last synced: 27 Jun 2024

https://github.com/superlinked/VectorHub

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

ai llm llmops ml mlops vector vector-database vector-search vectorops

Last synced: 26 Jun 2024

https://github.com/perlogix/dama

a simplified machine learning container platform that helps teams get started with an automated workflow

containers docker go golang machine-learning mlops moby

Last synced: 24 Jun 2024

https://github.com/AlexIoannides/ml-workflow-automation

Python Machine Learning (ML) project that demonstrates the archetypal ML workflow within a Jupyter notebook, with automated model deployment as a RESTful service on Kubernetes.

classification data-science flask helm jupyter-notebook kaggle kubernetes machine-learning mlops numpy pandas python rest-api sklearn

Last synced: 24 Jun 2024

https://github.com/nellaivijay/Awesome-AIML-Data-Ops

Awesome AI -ML-Data Ops

ai aiops awesome dataops mlops

Last synced: 20 Jun 2024

https://github.com/thoughtworks/mlops-platforms

Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...

azureml data-science databricks dataiku datarobot google-ai-platform h2oai iguazio knime kubeflow machine-learning mlflow mlops pachyderm sagemaker seldon

Last synced: 20 Jun 2024

https://github.com/aslotte/MLOps.NET

A machine learning model operations and management tool for ML.NET

aws azure csharp dotnetcore kubernetes-cluster kubernetes-deployment machinelearning mlnet mlops modelrepository

Last synced: 19 Jun 2024

https://github.com/databrickslabs/dbx

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

ci cicd databricks databricks-api databricks-cli mlops

Last synced: 16 Jun 2024

https://github.com/m3dev/kannon

Kannon is a wrapper for the gokart library that allows gokart tasks to be easily executed in a distributed and parallel manner on multiple kubernetes jobs.

gokart kubernetes machine-learning mlops task-pipeline

Last synced: 16 Jun 2024

https://github.com/adalkiran/distributed-inference

A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.

cross-language deep-learning distributed distributed-systems go golang machine-learning ml mlops onnx onnxruntime pion python redis redis-streams video-processing video-processing-pipeline webrtc yolo yolox

Last synced: 15 Jun 2024

https://github.com/kislyuk/aegea

Amazon Web Services Operator Interface

aws aws-batch aws-console cli cloud-init docker ec2 fargate genomics iam mlops

Last synced: 14 Jun 2024

https://github.com/dillionverma/llm.report

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

aiops gpt-3 gpt-4 llm llmops mlops nextjs nodejs open-source openai react shadcn-ui typescript

Last synced: 14 Jun 2024

https://github.com/fuzzylabs/awesome-open-mlops

The Fuzzy Labs guide to the universe of open source MLOps

datascience devops infrastructure machine-learning machinelearning mlops

Last synced: 14 Jun 2024

https://github.com/tensorchord/openmodelz

One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

cluster-manager hacktoberfest inference llmops mlops

Last synced: 14 Jun 2024

https://github.com/mohammad-oghli/CV-Models-Service

Computer Vision Deep Learning Models As Service

computer-vision deep-learning docker machine-learning mlops

Last synced: 12 Jun 2024

https://github.com/aws-samples/aws-ml-jp

SageMakerで機械学習モデルを構築、学習、デプロイする方法が学べるNotebookと教材集

aws data-science deep-learning jupyter-notebook machine-learning mlops sagemaker

Last synced: 11 Jun 2024

https://github.com/NeumTry/NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

ai chatgpt data data-engineering database embeddings etl llm llmops mlops ops pipeline python rag retrieval vector-database vectors

Last synced: 08 Jun 2024

https://github.com/alibaba/feathub

FeatHub - A stream-batch unified feature store for real-time machine learning

apache-flink data data-engineering data-quality data-science feature-engineering feature-store machine-learning mlops streaming

Last synced: 07 Jun 2024

https://github.com/alldatacenter/alldata

🔥🔥 AllData大数据产品是可定义数据中台，以数据平台为底座，以数据中台为桥梁，以机器学习平台为中层框架，以大模型应用为上游产品，提供全链路数字化解决方案。全新会员商业版 X 微信群：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

artificial-intelligence big-data chatgpt cloudeon cube-studio datart datasophon dinky dolphinscheduler flink griffin hudi iceberg kong mlops mlrun paimon ranger streampark tis

Last synced: 07 Jun 2024

https://github.com/microsoft/MLOps

MLOps examples

azureml mlops

Last synced: 07 Jun 2024

https://github.com/Azure/intelligent-app-workshop

Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamline backend workflows. Leverages Microsoft's Copilot stack, Semantic Kernel and Azure primitives to offer an engaging and comprehensive introduction to AI-infused app development and deployment

ai foundation-models gpt-35-turbo intelligent-agents intelligent-app llm ml mlops prompt-engineering semantic-kernel

Last synced: 07 Jun 2024

https://github.com/tensorchord/awesome-llmops

An awesome & curated list of best LLMOps tools for developers

ai-development-tools awesome-list llmops mlops

Last synced: 06 Jun 2024

https://github.com/DAGWorks-Inc/burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.

ai burr chatbot-framework dags generative-ai graphs llmops llms mlops persistent-data-structure state-machine state-management visibility

Last synced: 06 Jun 2024

https://github.com/microsoft/dstoolkit-mlops-base

Support ML teams to accelerate their model deployment to production leveraging Azure

azure-machine-learning dstoolkit mlops

Last synced: 03 Jun 2024

https://github.com/microsoft/hi-ml

HI-ML toolbox for deep learning for medical imaging and Azure integration

ai azure azureml deep-learning health healthcare machine-learning ml mlops python

Last synced: 03 Jun 2024

https://github.com/Azure/aml-run

GitHub Action that allows you to submit a run to your Azure Machine Learning Workspace.

aml azure azure-machine-learning data-science machine-learning mlops

Last synced: 03 Jun 2024

https://github.com/aws/amazon-sagemaker-examples

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

aws data-science deep-learning examples inference jupyter-notebook machine-learning mlops reinforcement-learning sagemaker training

Last synced: 03 Jun 2024

https://github.com/jozu-ai/kitops

Tools for easing the handoff between AI/ML and App/SRE teams.

ai code datasets devops devops-tools ml mlops mlops-tools models

Last synced: 03 Jun 2024

https://github.com/flyteorg/flytekit

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.

automation data data-science extensible flyte flyte-tasks hacktoberfest mlops pypi python sdk spark workflows

Last synced: 02 Jun 2024

https://github.com/lancedb/lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

apache-arrow computer-vision data-analysis data-analytics data-centric data-format data-science dataops deep-learning duckdb embeddings llms machine-learning mlops python rust

Last synced: 02 Jun 2024

https://github.com/tensorflow/tfx-addons

Developers helping developers. TFX-Addons is a collection of community projects to build new components, examples, libraries, and tools for TFX. The projects are organized under the auspices of the special interest group, SIG TFX-Addons. Join the group at http://goo.gle/tfx-addons-group

machine-learning mlops neural-network python special-interest-group tensorflow tfx

Last synced: 01 Jun 2024

https://github.com/Azure/mlops-templates

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.

azure azureml deep-learning machine-learning microsoft mlops mlops-environment mlops-project mlops-template mlops-workflow

Last synced: 31 May 2024

https://github.com/jacopotagliabue/post-modern-stack

Joining the modern data stack with the modern ML stack

dbt metaflow mlops recommender-system sagemaker

Last synced: 31 May 2024

https://github.com/SkalskiP/courses

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

computer-vision deep-learning deep-neural-networks generative-model machine-learning mlops multimodal natural-language-processing nlp stable-diffusion transformers tutorial

Last synced: 31 May 2024

https://github.com/SuperDuperDB/superduperdb

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

ai chatbot data database distributed-ml inference llm-inference llm-serving llmops ml mlops mongodb pretrained-models python pytorch rag semantic-search torch transformers vector-search

Last synced: 31 May 2024

https://github.com/dominodatalab/domino-research

Projects developed by Domino's R&D team

data-science mlflow mlops python sagemaker

Last synced: 27 May 2024

https://github.com/higgsfield-ai/higgsfield

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

cluster-management deep-learning distributed llama llama2 llm machine-learning mlops pytorch

Last synced: 27 May 2024

https://github.com/Writesonic/gptrouter

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

anthropic azure-openai cohere google-gemini langchain llama-index llm llmops llms mlops openai palm-api

Last synced: 22 May 2024

https://github.com/neptune-ai/neptune-r

📒 The MLOps stack component for experiment tracking (R interface)

compare language log management metadata metrics mlops models monitoring organize parameters r store tracker visualization

Last synced: 19 May 2024

https://github.com/SeldonIO/seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

aiops deployment kubernetes machine-learning machine-learning-operations mlops production-machine-learning serving

Last synced: 19 May 2024

https://github.com/onepanelio/onepanel

The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

ai aiops annotation computer-vision deeplearning etl hyperparameter-tuning inference jupyterlab labeling machinelearning mlops pipelines pytorch tensorboard tensorflow training workflows

Last synced: 19 May 2024

https://github.com/deployKF/deployKF

deployKF builds machine learning platforms on Kubernetes. We combine the best of Kubeflow, Airflow†, and MLflow† into a complete platform.

argocd artificial-intelligence gitops kubeflow kubernetes machine-learning mlops

Last synced: 19 May 2024

https://github.com/oscinis-com/Awesome-LLM-Productization

Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization

ai awesome awesome-list large-language-models llm llm-inference llm-serving llmops machine-learning mlops production transformer

Last synced: 19 May 2024

https://github.com/MLSysOps/Active-Learning-as-a-Service

A scalable & efficient active learning/data selection system for everyone.

active-learning automl deep-learning machine-learning mlops mlsys pytorch

Last synced: 18 May 2024

https://github.com/nantu-io/ntcore

Deploy and Monitor ML Model in Any Cloud

ai deep-learning docker kubernetes machine-learning ml mlops python pytorch sklearn tensorflow

Last synced: 17 May 2024

https://github.com/Cornerstone-OnDemand/modelkit

Toolkit for developing and maintaining ML models

fastapi machine-learning mlops production python

Last synced: 17 May 2024

https://github.com/FedML-AI/FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://fedml.ai) is your generative AI platform at scale.

ai-agent deep-learning distributed-training edge-ai federated-learning inference-engine machine-learning mlops model-deployment model-serving on-device-training

Last synced: 16 May 2024

https://github.com/weaviate/weaviate

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

approximate-nearest-neighbor-search generative-search grpc hnsw hybrid-search image-search information-retrieval mlops nearest-neighbor-search neural-search recommender-system search-engine semantic-search semantic-search-engine similarity-search vector-database vector-search vector-search-engine vectors weaviate

Last synced: 16 May 2024

https://github.com/postgresml/postgresml

The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

machine-learning ml mlops postgresql rust

Last synced: 16 May 2024

https://github.com/dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

analytics dagster data-engineering data-integration data-orchestrator data-pipelines data-science etl metadata mlops orchestration python scheduler workflow workflow-automation

Last synced: 16 May 2024

https://github.com/kedro-org/kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

experiment-tracking hacktoberfest kedro machine-learning machine-learning-engineering mlops pipeline python

Last synced: 15 May 2024