awesome-machine-learning-engineering

A curated list of articles, papers and tools for managing the building and deploying of machine learning models, aka machine learning engineering.
https://github.com/d18s/awesome-machine-learning-engineering

Last synced: 2 days ago
JSON representation

Example pipelines
Best practice
Big data on a single machine / on the command line
Software
- Managing building and deploying models
  - kubeflow
  - mlflow
  - datmo
- Managing building models
  - Luigi
  - Azkaban
  - Pinball
- Deploying models
  - Serving - performance serving system for machine learning models (Google)
  - deepdetect
  - clipper - latency prediction-serving system (Berkeley)
  - MLeap
  - openscoring - time scoring (<1 ms) of R, Scikit-Learn and Apache Spark models (openscoring)
  - hydro-serving - Machine Learning Serving cluster (hydrosphere.io)
- Serialising and transpiling models
  - jpmml-sklearn - line application for converting Scikit-Learn pipelines to PMML
  - sklearn2pmml - Learn pipelines to PMML
  - sklearn-porter - learn estimators to C, Java, JavaScript and others
  - Predictive Model Markup Language
- Monitoring models
  - Knowledge Repo - generation curated knowledge sharing platform for data scientists and other technical professions.
- AWS
  - Data Pipeline
  - Glue
  - Simple Workflow
  - Batch
  - Machine Learning - based service that makes it easy for developers of all skill levels to use machine learning technology"
  - Sagemaker
Related awesome lists
- Azure
Where to start
- A Few Useful Things to Know about Machine Learning
Data
Conference tracks and workshops

Programming Languages

Python 9 C++ 3 Java 3 Mustache 1 Scala 1 JavaScript 1 TypeScript 1 Jupyter Notebook 1

Categories

Example pipelines 79 Software 23 Best practice 9 Big data on a single machine / on the command line 8 Conference tracks and workshops 7 Data 4 Related awesome lists 3 Where to start 1

Sub Categories

Deploying models 6 AWS 6 Serialising and transpiling models 4 Managing building and deploying models 3 Managing building models 3 Azure 3 Monitoring models 1

Keywords

machine-learning 6 scikit-learn 5 data-science 4 tensorflow 4 python 4 deep-learning 3 serving 2 scheduling 2 xgboost 2 ml 2 spark 2 workflow 2 collaborative 1 neural-network 1 deep-neural-networks 1 cpp 1 workflow-engine 1 azkaban 1 production 1 orchestration-framework 1 luigi 1 hadoop 1 version-control 1 reproducibility 1 artificial-intelligence 1 dask 1 numpy 1 notebook 1 pandas 1 pydata 1 minikube 1 scipy 1 kubernetes 1 kubeflow 1 jupyter 1 google-kubernetes-engine 1 transformers 1 apache-spark 1 api 1 lightgbm 1 pmml 1 r 1 real-time 1 models 1 pipelines 1 realtime 1 scoring 1 serverless 1 sklearn 1 data 1