https://github.com/microsoft/onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://github.com/microsoft/onnxruntime

ai-framework deep-learning hardware-acceleration machine-learning neural-networks onnx pytorch scikit-learn tensorflow

Last synced: 8 months ago
JSON representation

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

• Host: GitHub
• URL: https://github.com/microsoft/onnxruntime
• Owner: microsoft
• License: mit
• Created: 2018-11-10T02:22:53.000Z (over 7 years ago)
• Default Branch: main
• Last Pushed: 2025-05-05T10:12:37.000Z (about 1 year ago)
• Last Synced: 2025-05-05T11:18:18.697Z (about 1 year ago)
• Topics: ai-framework, deep-learning, hardware-acceleration, machine-learning, neural-networks, onnx, pytorch, scikit-learn, tensorflow
• Language: C++
• Homepage: https://onnxruntime.ai
• Size: 1.24 GB
• Stars: 16,465
• Watchers: 253
• Forks: 3,185
• Open Issues: 3,212
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Citation: CITATION.cff
  • Codeowners: CODEOWNERS
  • Security: SECURITY.md
  • Roadmap: docs/Roadmap.md

Awesome Lists containing this project

• fucking-awesome-cpp - ONNX runtime - C and C++ library for training and inference ONNX models. ONNX is a standard that AI models can be converted into, regardless of the library they are trained with. [MIT] 🌎 [website](onnxruntime.ai/) (Machine Learning)
• Awesome-Azure-Advanced-Analytics - ONNX Runtime
• awesome-mlops - ONNX Runtime
• Jupyter-Guide - ONNX Runtime - platform, high performance ML inferencing and training accelerator. It supports models from deep learning frameworks such as PyTorch and TensorFlow/Keras as well as classical machine learning libraries such as scikit-learn, LightGBM, XGBoost, etc. (PyTorch Tools, Libraries, and Frameworks)
• awesome-production-machine-learning - ONNX Runtime - ONNX Runtime is a cross-platform inference and training machine-learning accelerator. (Model Serving and Monitoring)
• awesome-github-projects - onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator ⭐20,515 `C++` 🔥 (🤖 AI & Machine Learning)
• cpp-learning-2025 - microsoft/onnxruntime - platform model inference | (Real-World Projects / AI / Machine Learning)
• bert-in-production - microsoft/onnxruntime - sourced by Microsoft; it contains several model-specific optimisations including one for transformer models. A model's architecture is compiled into the Open Neural Network Exchange (ONNX) standard and optionally optimised for a specific platform's hardware. (Implementations)
• awesome-open-source-ai-tools - microsoft/onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator (Research & Data Analysis)
• awesome-tts-stt - ONNX Runtime - platform ML inference | (Tooling & Infrastructure / Deployment & Optimization)
• StarryDivineSky - microsoft/onnxruntime
• awesome-yolo-object-detection - ONNX Runtime - platform, high performance ML inferencing and training accelerator. [onnxruntime.ai](https://onnxruntime.ai/) (Lighter and Deployment Frameworks)
• AiTreasureBox - microsoft/onnxruntime - 11-03_18262_3](https://img.shields.io/github/stars/microsoft/onnxruntime.svg)|ONNX Runtime: cross-platform, high-performance ML inferencing and training accelerator| (Repos)
• awesome-mojo - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
• awesome-llm-prod - ONNX Runtime - Optimization|Cross-platform, high performance ML inferencing and training accelerator| (1. **Large Language Models**)
• awesome-edge-computing - ONNX Runtime
• awesome-emdl - Microsoft - ONNX RUntime - cross-platform, high performance ML inferencing and training accelerator. (Libraries / Inference Framework)
• AwesomeCppGameDev - onnxruntime - platform, high performance scoring engine for ML models (AI)
• awesome-cpp - ONNX runtime - C and C++ library for training and inference ONNX models. ONNX is a standard that AI models can be converted into, regardless of the library they are trained with. [MIT] [website](https://onnxruntime.ai/) (Machine Learning)
• awesome-opensource-ai - ONNX Runtime - High-performance inference and training for ONNX models across hardware. (📋 Contents / 🧬 1. Core Frameworks & Libraries)
• llmops - ONNX Runtime - platform ML accelerator |  | (Optimization & Performance / Resources)
• awesome-cpp-with-stars - ONNX runtime - 03-03 | (Machine Learning)
• awesome-musicdsp - ONNXRuntime - Microsoft's ONNX Runtime is a ML inference engine that is well documented, performant, and customizable. [Here](https://github.com/olilarkin/iPlug2OnnxRuntime) is an iPlug2 example that I prepared that integrates onnxruntime into an audio plugin, using [ort-builder](https://github.com/olilarkin/ort-builder) - another project that I made in order to build custom, slimmed down static libraries for the onnxruntime (Machine Learning)
• awesome-foss-manufacturing - ONNX Runtime - platform inference engine. Enables deploying trained models to edge devices at fabrication nodes. | MIT | (Machine Learning for Manufacturing / ML Frameworks)
• awesome-vision-ai-stack - ONNX Runtime Web - Cross-platform model inference in browser; standardized format. (Local Inference and Serving / Run in browser (zero-setup inference))