Projects in Awesome Lists tagged with llm-infernece

A curated list of projects in awesome lists tagged with llm-infernece .

• Sort

  • Recently synced
  • Stars

https://github.com/sophgo/llm-tpu

Run generative AI models in sophgo BM1684X

bm1684x chatglm generative-ai large-language-models llama2 llama3 llm llm-inference llm-infernece qwen qwen-7b qwen1-5 qwen2

Last synced: 13 Apr 2025

https://github.com/pandada8/llm-inference-benchmark

LLM 推理服务性能测试

llm-infernece

Last synced: 15 Feb 2025