Projects in Awesome Lists tagged with tgi
A curated list of projects in awesome lists tagged with tgi .
https://github.com/opea-project/GenAIExamples
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
chatqna codegen copilot gaudi2 genai llms rag summarization tgi xeon
Last synced: 04 Apr 2025
https://github.com/zrzrzrzrzrzrzr/lm-fly
大模型推理框架加速，让 LLM 飞起来
llm llm-inference mlx openvino tensorrt-llm tgi vllm
Last synced: 08 Aug 2025
https://github.com/slinusc/bench360
Bench360 is a modular benchmarking suite for local LLM deployments. It offers a full-stack, extensible pipeline to evaluate the latency, throughput, quality, and cost of LLM inference on consumer and enterprise GPUs. Bench360 supports flexible backends, tasks and scenarios, enabling fair and reproducible comparisons for researchers & practitioners.
bench360 benchmark deployment energy energy-consumption engine framework inference llm llm-inference local mldeploy optimization performance quantization sglang tgi vllm
Last synced: 28 Apr 2026
https://github.com/rahulunair/xpu_tgi
TGI server setup for Intel Data Centre GPUs
intel intelgpu llm llm-inference tgi xpu
Last synced: 16 Mar 2025
https://github.com/aisingapore/sealion-sampler
Lightweight HTML form with Python Flask app and accompanying scripts for swift testing of interactions with SEA-LION family of LLMs.
flask-application large-language-models ollama tgi
Last synced: 20 Apr 2026
