Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
https://github.com/EthicalML/awesome-production-machine-learning

Last synced: 15 days ago
JSON representation

Filtered by Go. Clear filters

AutoML

  • go-featureprocessing - featureprocessing.svg?style=social) - A feature pre-processing framework in Go that matches functionality of sklearn.

Data Pipeline

  • Argo Workflows - workflows.svg?style=social) - Argo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition).
  • Flyte - Lyft’s Cloud Native Machine Learning and Data Processing Platform - (Demo).
  • Pachyderm - Open source distributed processing framework build on Kubernetes focused mainly on dynamic building of production machine learning pipelines - (Video).

Data Storage Optimisation

  • AIStore - AIStore is a lightweight object storage system with the capability to linearly scale out with each added storage node and a special focus on petascale deep learning.
  • Milvus - io/milvus.svg?style=social) Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.
  • Weaviate - A low-latency vector search engine (GraphQL, RESTful) with out-of-the-box support for different media types. Modules include Semantic Search, Q&A, Classification, Customizable Models (PyTorch/TensorFlow/Keras), and more.
  • Casibase - Casibase is a LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO.

Deployment and Serving

  • Cortex - Cortex is an open source platform for deploying machine learning models—trained with any framework—as production web services. No DevOps required.
  • KServe - KServe provides a Kubernetes Custom Resource Definition for serving predictive and generative ML.
  • Nuclio - A high-performance "serverless" framework focused on data, I/O, and compute-intensive workloads. It is well integrated with popular data science tools, such as Jupyter and Kubeflow; supports a variety of data and streaming sources; and supports execution over CPUs and GPUs.
  • Model Runner - runner.svg?cacheSeconds=86400) - Docker Model Runner makes it easy to manage, run, and serve AI models using Docker, supporting LLMs and other AI models pulled directly from Docker Hub or any OCI-compliant registry.
  • Bifrost - AI gateway providing a single OpenAI-compatible API across 23+ LLM providers, with automatic fallbacks, load balancing, semantic caching, budget governance and Prometheus metrics.

Feature Store

  • Featureform - A virtual featurestore. Plug-&-play with your existing infra. Data Scientist approved. Discovery, Governance, Lineage, & Collaboration just a pip install away. Supports pandas, Python, spark, SQL + integrations with major cloud vendors.

Industry Strength Information Retrieval

  • RAGFlow - RAGFlow is a RAG engine based on deep document understanding.

Industry Strength Natural Language Processing

  • Ollama - Get up and running with large language models, locally.

Industry Strength Recommender System

  • Gorse - io/gorse.svg?style=social) - Gorse aims to be a universal open-source recommender system that can be quickly introduced into a wide variety of online services.

Model, Data and Experiment Management

  • Dolt - Dolt is a SQL database that you can fork, clone, branch, merge, push and pull just like a git repository.
  • KitOps - ai/kitops.svg?style=social) - KitOps is an open and standards-based packaging and versioning system for AI/ML projects that works with all the AI/ML, development, and DevOps tools you are already using.
  • lakeFS - Repeatable, atomic and versioned data lake on top of object storage.
  • HuggingFace Model Downloader - HuggingFace Model Downloader is a utility tool for downloading models and datasets from the HuggingFace website. It offers multithreaded downloading for LFS files and ensures the integrity of downloaded models with SHA256 checksum verification.
  • KitOps - ml/kitops.svg?cacheSeconds=172800) - KitOps is an open and standards-based packaging and versioning system for AI/ML projects that works with all the AI/ML, development, and DevOps tools you are already using.

Model, Data and Experiment Tracking

  • ormb - Docker for Your ML/DL Models Based on OCI Artifacts.

Model Training and Orchestration

  • Determined - ai/determined.svg?style=social) - Deep learning training platform with integrated support for distributed training, hyperparameter tuning, and model management (supports Tensorflow and Pytorch).
  • envd - Machine learning development environment for data science and AI/ML engineering teams.
  • Skaffold - Skaffold is a command line tool that facilitates continuous development for Kubernetes applications. You can iterate on your application source code locally then deploy to local or remote Kubernetes clusters.

Privacy and Safety

  • Google's Differential Privacy - privacy.svg?style=social) - This is a C++ library of ε-differentially private algorithms, which can be used to produce aggregate statistics over numeric data sets containing private or sensitive information.

Training Orchestration

  • Nos - ai/nos.svg?style=social) - Nos is an open-source platform to efficiently run AI workloads on Kubernetes, increasing GPU utilization and reducing infrastructure and operational costs.