awesome-tinyml
TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.
https://github.com/umitkacar/awesome-tinyml
Last synced: about 9 hours ago
JSON representation
-
🖼️ **Additional Model Architectures**
-
🔬 **EtinyNet**
-
🎯 **PP-PicoDet**
-
🎬 **VQRF** - Video Compression
-
-
⚙️ **Compilers & Low-Level Frameworks**
-
🔷 **ARM-NN**
-
🧠 **CMSIS-NN**
-
🍎 **CoreML** - Apple
-
🔨 **LLVM**
-
📱 **Samsung ONE**
-
🔧 **TVM** - Apache
-
⚡ **XNNPack** - Google
-
-
🧠 **Computing Architectures & APIs**
-
🎓 **Contributing & Community**
-
📖 **Foundational Surveys (2024-2025)**
-
📊 **Repository Stats**
-
-
🌐 **Edge Deployment Frameworks**
-
🍎 **CoreML** - Apple
- Apple
- Semantic Segmentation CoreML
- CoreML Models Collection
- Awesome CoreML Models
- Awesome CoreML Models 2
- RobustVideoMatting
- PyTorch to CoreML
- CoreML Helpers
- Apple ML API
- CoreML Performance Tool
- Apple ML Stable Diffusion
- Stable Diffusion 2 Base
- Stability AI SD
- Stable Diffusion v1.4
- RunwayML SD
- Automatic1111 WebUI
-
💎 **DeepSparse & SparseML** - Neural Magic
-
🚀 **FastDeploy** - PaddlePaddle
-
🔧 **MACE** - Xiaomi
-
📱 **NCNN** - Tencent
-
⚡ **TensorRT**
-
-
🔩 **Hardware Acceleration & Platforms**
-
🛠️ **Implementation Resources & Tools**
-
📱 **Mobile Deployment Targets**
-
🔷 **ONNX Runtime**
-
📉 **ONNX Runtime Quantization**
-
⚡ **TensorRT**
-
🎯 **YOLO Implementations**
- YOLO-NAS ONNXRuntime
- YOLOv8-TensorRT-CPP
- TensorRT C++ API
- YOLOv8-TensorRT (Python + C++)
- YOLO Pose C++
- TensorRT Samples
- YOLOv8 TensorRT Tutorial
- YOLOv8-ONNX-CPP
- YOLOv8 Pose Implementation
- YOLOv8 TensorRT Pose
- YOLO-ONNXRuntime-CPP
- YOLOv8-OpenCV-ONNXRuntime-CPP
- Ultralytics YOLOv8 C++
- YOLOv6-OpenCV-ONNXRuntime
- YOLOv5 Pose OpenCV
- hpc203 Repositories
- YOLO Issue Discussions
- YOLOv5 Fixed Bugs
- Chinese Tutorial
- ONNX Runtime Install Guide
-
-
💼 **Industry & Commercial Solutions**
-
🚀 **Deeplite**
-
📱 **Samsung ONE**
-
-
🚀 **Inference Frameworks & Runtimes**
-
📱 **eMamba**
-
🦙 **ExecuTorch**
-
💻 **llama.cpp**
-
⚡ **TensorRT-LLM**
-
📄 **vLLM**
-
-
🔧 **Model Compression & Optimization**
-
📉 **Advanced Quantization Techniques**
-
🎓 **Knowledge Distillation & Pruning**
-
💻 **llama.cpp**
-
🔬 **Neural Architecture Search (NAS)**
-
-
🚀 **Quick Start & Development**
-
📚 **Research Papers & Academic Resources**
-
🔬 **EtinyNet**
-
📖 **Foundational Surveys (2024-2025)**
- Deep Learning With Edge Computing: A Review
- Convergence of Edge Computing and Deep Learning
- Machine Learning at the Network Edge
- Edge Deep Learning in CV & Medical Diagnostics
- EtinyNet: Extremely Tiny Network
- Ultra-low Power TinyML System
- Mamba-360: Survey of SSMs
- ViT for Mobile/Edge Devices
- YOLO Evolution: v5 to YOLO26
- YOLOv10: Real-Time Detection
- NAS Systematic Review (2024)
- Advances in Neural Architecture Search
- Awesome Embedded and Mobile Deep Learning
- Edge Deep Learning in CV & Medical Diagnostics
- ViT for Mobile/Edge Devices
- NAS Systematic Review (2024)
- Edge Deep Learning in CV & Medical Diagnostics
- ViT for Mobile/Edge Devices
- NAS Systematic Review (2024)
- Edge Deep Learning in CV & Medical Diagnostics
- ViT for Mobile/Edge Devices
- NAS Systematic Review (2024)
- Edge Deep Learning in CV & Medical Diagnostics
- Edge Deep Learning in CV & Medical Diagnostics
- Ultra-low Power TinyML System
- ViT for Mobile/Edge Devices
- NAS Systematic Review (2024)
-
-
🤖 **Small Language Models (SLMs) for Edge**
-
📱 **Efficient Vision Models for Edge**
-
🌟 **Google Gemini Nano**
-
🦙 **Meta Llama 3.2**
-
🧠 **Microsoft Phi-3**
-
📷 **MobileVLM**
-
🦙 **TinyLlama**
-
-
🔥 **SOTA Models & Algorithms (2024-2025)**
-
📱 **Efficient Vision Models for Edge**
-
Categories
🛠️ **Implementation Resources & Tools**
42
🌐 **Edge Deployment Frameworks**
31
📚 **Research Papers & Academic Resources**
29
🔧 **Model Compression & Optimization**
24
🔥 **SOTA Models & Algorithms (2024-2025)**
22
⚙️ **Compilers & Low-Level Frameworks**
15
🚀 **Inference Frameworks & Runtimes**
11
🎯 **TinyML & MCU-specific Advances**
10
🤖 **Small Language Models (SLMs) for Edge**
9
⚡ **State Space Models - Efficient Transformers**
8
🚀 **Quick Start & Development**
7
🎓 **Contributing & Community**
7
🧠 **Computing Architectures & APIs**
7
🔩 **Hardware Acceleration & Platforms**
6
🔧 **Utility Frameworks & Tools**
6
🖼️ **Additional Model Architectures**
5
💼 **Industry & Commercial Solutions**
3
Sub Categories
📖 **Foundational Surveys (2024-2025)**
31
🎯 **YOLO Implementations**
20
🍎 **CoreML** - Apple
18
📱 **Efficient Vision Models for Edge**
14
🔷 **ONNX Runtime**
13
🎓 **Knowledge Distillation & Pruning**
12
🔬 **EtinyNet**
11
📉 **Advanced Quantization Techniques**
8
🎯 **Object Detection Models**
7
🧠 **MCUNet Series** - MIT HAN Lab
6
📱 **NCNN** - Tencent
6
🎓 **Community**
5
⚡ **TensorRT**
5
💻 **llama.cpp**
5
📱 **eMamba**
4
📉 **ONNX Runtime Quantization**
4
🔬 **TinyDL (Tiny Deep Learning)**
4
🖥️ **Edge AI Platforms**
4
🐍 **Mamba**
4
🔬 **Neural Architecture Search (NAS)**
3
👁️ **OpenCV**
3
🎬 **VQRF** - Video Compression
3
🔷 **ARM-NN**
3
🚀 **Deeplite**
3
📷 **MobileVLM**
3
💎 **DeepSparse & SparseML** - Neural Magic
3
📊 **Repository Stats**
3
🎯 **Features**
3
⚡ **TensorRT-LLM**
3
📱 **Samsung ONE**
3
🦙 **Meta Llama 3.2**
2
🧠 **Microsoft Phi-3**
2
🎯 **PP-PicoDet**
2
🔧 **MACE** - Xiaomi
2
📱 **Mobile Deployment Targets**
2
🔧 **TVM** - Apache
2
🦙 **ExecuTorch**
2
🚀 **FastDeploy** - PaddlePaddle
2
📄 **vLLM**
2
🧠 **CMSIS-NN**
2
🔨 **LLVM**
2
⚡ **XNNPack** - Google
2
📦 **Installation**
1
🌟 **Google Gemini Nano**
1
🦙 **TinyLlama**
1
🛠️ **Development Setup**
1
Keywords
machine-learning
9
deep-learning
8
onnx
5
neural-network
5
ios
5
coreml
4
computer-vision
3
pytorch
3
object-detection
3
tensorrt
3
inference
3
swift
3
ai
3
yolov8
3
coremltools
3
coreml-framework
3
vulkan
2
yolov5
2
performance
2
opencl
2
jetson
2
neural-networks
2
compiler
2
simd
2
android
2
model
2
ios11
2
cpp
2
onnxruntime
2
coreml-models
2
stable-diffusion
2
core-ml
2
caffe
2
awesome-list
2
awesome
2
ncnn
1
mxnet
1
riscv
1
tensorflow
1
ai-art
1
diffusion
1
gradio
1
image-generation
1
image2image
1
img2img
1
text2image
1
apple
1
caffemodel
1
coreml-model
1
curated-list
1