An open API service indexing awesome lists of open source software.

https://github.com/pythoninthegrass/llm_bench

Python wrapper for localscore 📊
https://github.com/pythoninthegrass/llm_bench

huggingface llama llm python

Last synced: 5 months ago
JSON representation

Python wrapper for localscore 📊

Awesome Lists containing this project

README

          

# llm_bench

Simple self-contained script to benchmark GGUF models with localscore.

Downloads localscore, any GGUF model from HuggingFace, and runs the benchmark.