Projects in Awesome Lists tagged with mbpp
A curated list of projects in awesome lists tagged with mbpp .
https://github.com/abhaymundhara/llm-benchmark-suite
Benchmark suite for evaluating LLMs and SLMs on coding and SE tasks. Features HumanEval, MBPP, SWE-bench, and BigCodeBench with an interactive Streamlit UI. Supports cloud APIs (OpenAI, Anthropic, Google) and local models via Ollama. Tracks pass rates, latency, token usage, and costs.
benchmark bigcodebench claude code-generation evaluation gemini humaneval llm mbpp ollama openai python streamlit swe-bench
Last synced: 29 Apr 2026
https://github.com/jcartu/qwen-bench-2026-05-11-v2-followup
Study #4: FP8+MTP{3,5} speed on repne/vllm:v2 + max_tokens=8192 quality re-runs for BF16+DFlash n=8 and FP8+MTP=3. Follow-up to studies #2 and #3.
benchmark blackwell dflash humaneval inference mbpp mtp qwen-bench qwen3 speculative-decoding vllm
Last synced: 12 Jun 2026
https://github.com/jcartu/llm-stress-harness
Diagnostic toolkit for self-hosted LLM inference: failure-taxonomic stress harness + 4-phase orchestrator + parametric vLLM launchers
benchmarking humaneval inference llm mbpp python sglang speculative-decoding stress-testing vllm
Last synced: 12 Jun 2026