Ecosyste.ms: Awesome

https://github.com/anilsathyan7/Portrait-Segmentation

Real-time portrait segmentation for mobile devices

android color-harmonization coral-tpu deeplab deeplearning deepstream edge-ai gpu-delegate int8-inference jetson-tx2 keras mediapipe mobilenetv2 opencv-dnn portrait-matting portrait-segmentation tensorflow tensorflow-lite tensorflowjs unet-image-segmentation

Last synced: 05 Nov 2024

https://github.com/BUG1989/caffe-int8-convert-tools

Generate a quantization parameter file for ncnn framework int8 inference

caffe deeplearning-ai int8-inference ncnn quantized-neural-networks

Last synced: 28 Oct 2024

https://github.com/DerryHub/BEVFormer_tensorrt

BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).

bevformer cuda int8-inference pytorch quantization tensorrt-plugins

Last synced: 28 Oct 2024

https://github.com/enot-autodl/gpt-j-6b-tensorrt-int8

GPT-J 6B inference on TensorRT with INT-8 precision

enot-autodl gpt-j gpt-j-6b inference int8-inference quantization tensorrt transformers

Last synced: 07 Nov 2024

https://github.com/johnclaw/chatllm.vb

VB.NET api wrapper for llm-inference chatllm.cpp

api-wrapper bindings chatllm cpu-inference gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen vb-net vbnet

Last synced: 22 Dec 2024

https://github.com/johnclaw/chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

api-wrapper bindings chatllm cpu-inference csharp gemma ggml inference int8 int8-inference int8-quantization llama llm llm-inference llms mistral qwen

Last synced: 22 Dec 2024

https://github.com/jahongir7174/yolov8-qat

Quantization Aware Training

int8-inference int8-quantization object-detection python pytorch quantization-aware-training yolov8

Last synced: 18 Nov 2024

https://github.com/enot-autodl/enot-transformers

enot-autodl gpt2 gptj inference int8-inference int8-quantization quantization tensorrt transformers

Last synced: 07 Nov 2024

https://github.com/akashad98/yolov7_vino_with_object_tracking

it has support for openvino converted model of yolov7-int.xml ,yolov7x,

deepsort int8-inference onnx openvino yolov7

Last synced: 29 Nov 2024