Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with gptq
A curated list of projects in awesome lists tagged with gptq .
https://github.com/intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
auto-tuning awq fp4 gptq int4 int8 knowledge-distillation large-language-models low-precision mxformat post-training-quantization pruning quantization quantization-aware-training smoothquant sparsegpt sparsity
Last synced: 01 Oct 2024
https://github.com/shm007g/LLaMA-Cult-and-More
Large Language Models for All, 🦙 Cult and More, Stay in touch !
alpaca chatgpt deepspeed ggml gpt gpt4 gptq llama llm loralib pytorch tensorflow transformers vicuna
Last synced: 31 Jul 2024
https://github.com/bobazooba/xllm
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
alpaca bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral openai pytorch torch vicuna zephyr
Last synced: 27 Sep 2024
https://github.com/1b5d/llm-api
Run any Large Language Model behind a unified API
chatgpt gptq huggingface langchain llama llamacpp llm llm-inference machine-learning python
Last synced: 27 Sep 2024
https://github.com/chenhunghan/ialacol
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
ai cloudnative cuda ggml gptq gpu helm kubernetes langchain llamacpp llm llm-inference llm-serving openai python
Last synced: 27 Sep 2024
