Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-osml-for-devs
List of resources, libraries and more for developers who would like to build with open-source machine learning off-the-shelf
https://github.com/merveenoyan/awesome-osml-for-devs
Last synced: 1 day ago
JSON representation
-
LLMs
-
Tools
- Text Embedding Inference
- Text Generation Inference
- Ollama
- Open Webui - rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs.
- TGI Benchmark
- Open LLM Leaderboard - source LLM for your use and budget.
- TGI Benchmark
- Open LLM Leaderboard - source LLM for your use and budget.
- Ollama
- Open Webui - rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs.
-
-
Libraries, Platforms and Development Platform-specific Resources
-
Development Platform
- huggingface.js
- TensorFlow.js
- Mediapipe
- TensorFlow Lite
- huggingface.dart
- flutter-tflite
- NCNN - performance neural network inference framework optimized for the mobile platform.
- TorchServe
- Tensorflow Serving - performance serving system for machine learning models, designed for production environments.
- PyTorch
- Transformers.js - browser.
- Inference - to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
- Nvidia Triton Inference Server
- PyTrion - like interface that simplifies Triton's deployment in Python environments. The library allows serving Machine Learning models directly from Python through NVIDIA's Triton Inference Server.
- MediaPipe Unity Plugin
- Hugging Face API for Unity 🤗 - to-use integration for the Hugging Face Inference API, allowing developers to access and use Hugging Face AI models within their Unity projects.
- huggingface.dart
- flutter-tflite
- ONNX Runtime
- PyTorch
- Transformers.js - browser.
- NCNN - performance neural network inference framework optimized for the mobile platform.
- Text Generation Inference
- Text Embedding Inference
- TorchServe
- Tensorflow Serving - performance serving system for machine learning models, designed for production environments.
- huggingface.js
- TensorFlow.js
- Mediapipe
- TensorFlow Lite
- Inference - to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
- Nvidia Triton Inference Server
- PyTrion - like interface that simplifies Triton's deployment in Python environments. The library allows serving Machine Learning models directly from Python through NVIDIA's Triton Inference Server.
- MediaPipe Unity Plugin
- Hugging Face API for Unity 🤗 - to-use integration for the Hugging Face Inference API, allowing developers to access and use Hugging Face AI models within their Unity projects.
- ONNX Runtime
- ExecuTorch - device ML in everywhere from AR/VR wearables to mobile/edge devices for PyTorch models.
- ExecuTorch - device ML in everywhere from AR/VR wearables to mobile/edge devices for PyTorch models.
-
Platforms
- Hugging Face Hub - source models able to work off-the-shelf in [/models](https://huggingface.co/models).
- Kaggle Models
- Pytorch Hub - trained model repository designed for research exploration.
- Kaggle Models
- Pytorch Hub - trained model repository designed for research exploration.
- Hugging Face Hub - source models able to work off-the-shelf in [/models](https://huggingface.co/models).
-
-
Modalities and Tasks
-
Multimodal Models
-
Tools
- Awesome Open-source Foundation and Multimodal Models - shot capabilities and the models that can take in two different modalities (e.g. a model that can take in image and text and output text).
- Awesome Open-source Foundation and Multimodal Models - shot capabilities and the models that can take in two different modalities (e.g. a model that can take in image and text and output text).
-
Models and Demos
- Kosmos-2 - 2 model by Microsoft, that can understand image and text, answer questions about images, caption images, detect objects on images and gives answer without hallucinating.
- Fuyu-8B - 8b by Adept, that can understand image and text and answer questions about images and caption images.
- Kosmos-2 - 2 model by Microsoft, that can understand image and text, answer questions about images, caption images, detect objects on images and gives answer without hallucinating.
- Fuyu-8B - 8b by Adept, that can understand image and text and answer questions about images and caption images.
-
-
Understanding Image and Text
-
Document AI
-
-
Generative AI
-
Models and Demos
- Stable Cascade - of-the-art image generation model Stable Cascade. (as of March '24)
- Stable Cascade - of-the-art image generation model Stable Cascade. (as of March '24)
- Stable Diffusion XL Inpainting
- Stable Diffusion XL Inpainting
-
-
Resources
- Open-source AI Cookbook - source models and libraries.
- Tasks - the-shelf.
- Open-source AI Cookbook - source models and libraries.
-
Other
-
Computer Vision
-
Models and Demos
- OWL - shot object detection model. (as of March '24)
- Segment Anything - shot image segmentation model. (as of March '24)
- Depth Anything
- OWL - shot object detection model. (as of March '24)
- Segment Anything - shot image segmentation model. (as of March '24)
- Depth Anything
-
-
Audio
-
Models and Demos
- Insanely Fast Whisper - device.
- Open TTS Tracker - source text-to-speech models.
- Insanely Fast Whisper - device.
- Open TTS Tracker - source text-to-speech models.
-
Programming Languages
Categories
Sub Categories
Keywords
inference
6
machine-learning
4
deep-learning
4
llava
4
computer-vision
4
llm
4
llms
4
ollama
4
onnx
4
go
2
golang
2
llama
2
llama2
2
llama3
2
mistral
2
phi3
2
classification
2
deployment
2
docker
2
inference-api
2
inference-server
2
android
2
arm-neon
2
artificial-intelligence
2
caffe
2
darknet
2
high-preformance
2
ios
2
keras
2
mlir
2
mxnet
2
ncnn
2
neural-network
2
pytorch
2
riscv
2
simd
2
tensorflow
2
vulkan
2
gemma
2
gemma2
2
open-webui
2
openai
2
rag
2
self-hosted
2
ui
2
webui
2
blip
2
clip
2
foundational-models
2
grounding-dino
2