https://github.com/abhaymundhara/llm-benchmark-suite

Benchmark suite for evaluating LLMs and SLMs on coding and SE tasks. Features HumanEval, MBPP, SWE-bench, and BigCodeBench with an interactive Streamlit UI. Supports cloud APIs (OpenAI, Anthropic, Google) and local models via Ollama. Tracks pass rates, latency, token usage, and costs.

benchmark bigcodebench claude code-generation evaluation gemini humaneval llm mbpp ollama openai python streamlit swe-bench

Last synced: 29 Apr 2026