Projects in Awesome Lists tagged with int4
A curated list of projects in awesome lists tagged with int4 .
https://intel.github.io/neural-compressor/
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
auto-tuning awq fp4 gptq int4 int8 knowledge-distillation large-language-models low-precision mxformat post-training-quantization pruning quantization quantization-aware-training smoothquant sparsegpt sparsity
Last synced: 09 Dec 2025
https://github.com/intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
auto-tuning awq fp4 gptq int4 int8 knowledge-distillation large-language-models low-precision mxformat post-training-quantization pruning quantization quantization-aware-training smoothquant sparsegpt sparsity
Last synced: 12 May 2025
https://github.com/tpoisonooo/how-to-optimize-gemm
row-major matmul optimization
arm64 armv7 cuda cuda-kernel gemm-optimization int4 ptx vulkan
Last synced: 04 Apr 2025
https://github.com/intel/auto-round
Advanced Quantization Algorithm for LLMs/VLMs.
awq gptq int4 neural-compressor quantization rounding
Last synced: 12 Feb 2026
https://github.com/danaozhong/rust-bitwriter
rust library to write integer types of any bit length into a buffer - from `i1` to `i64`.
bitbanging bitbuffer bitwriter bytebuffer int15 int4 rust
Last synced: 30 Aug 2025
https://github.com/ambv231/tinyllama-coreml-ios18-quantization
Quantize TinyLlama-1.1B-Chat from PyTorch to CoreML (float16, int8, int4) for efficient on-device inference on iOS 18+.
ai apple-silicon coreml huggingface int4 int8 ios18 llama llm mlpackage mobile nlp on-device pytorch quantization tinyllama transformers
Last synced: 30 Apr 2026
