Projects in Awesome Lists tagged with text-generation-inference
A curated list of projects in awesome lists tagged with text-generation-inference .
https://github.com/huggingface/optimum-benchmark
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
benchmark neural-compressor onnxruntime openvino pytorch tensorrt-llm text-generation-inference
Last synced: 04 Dec 2024
https://github.com/inftyai/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
huggingface inference inference-platform kubernetes llamacpp llm modelscope ollama sglang text-generation-inference vllm
Last synced: 05 Apr 2025
https://github.com/yjg30737/pyqt-text-generation-inference-gui
GUI version of text-generation-inference
huggingface pyqt pyqt5 text-generation text-generation-inference text-generation-webui
Last synced: 13 Apr 2025
https://github.com/aisingapore/sealion-tgi
Serve the AI Singapore SEA-LION model ⚛ with TGI
Last synced: 16 Jan 2025
https://github.com/akshint0407/nano-r1
This project demonstrates the process of fine-tuning the Qwen2.5-3B-Instruct model using GRPO (Generalized Reward Policy Optimization) on the GSM8K dataset.
adapters grpo huggingface python qwen2-5 safetensors text-generation-inference transformer trl unsloth
Last synced: 09 Apr 2025
https://github.com/mikesterner87/nano-r1
This project demonstrates the process of fine-tuning the Qwen2.5-3B-Instruct model using GRPO (Generalized Reward Policy Optimization) on the GSM8K dataset.
adapters build grpo huggingface nanopi nanopi-r1 nanopi-r1s openwrt python safetensors text-generation-inference transformer trl unsloth
Last synced: 10 Apr 2025
