https://github.com/fboulnois/llm-leaderboard-csv
CSVs of the Huggingface and LMArena LLM leaderboards, along with the code to generate them in Python and R.
https://github.com/fboulnois/llm-leaderboard-csv
chatgpt csv huggingface llama llama2 llama3 llm lmsys mistral open-llm-leaderboard openai python r
Last synced: 9 months ago
JSON representation
CSVs of the Huggingface and LMArena LLM leaderboards, along with the code to generate them in Python and R.
- Host: GitHub
- URL: https://github.com/fboulnois/llm-leaderboard-csv
- Owner: fboulnois
- License: mpl-2.0
- Created: 2024-06-19T13:48:23.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-09-02T11:09:56.000Z (10 months ago)
- Last Synced: 2025-09-27T03:51:37.988Z (9 months ago)
- Topics: chatgpt, csv, huggingface, llama, llama2, llama3, llm, lmsys, mistral, open-llm-leaderboard, openai, python, r
- Language: Python
- Homepage:
- Size: 4.15 MB
- Stars: 29
- Watchers: 0
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
# LLM Leaderboard CSVs
Generates CSVs of the [LMArena Leaderboard](https://lmarena.ai/leaderboard) in Python.
The latest LMArena CSVs can be downloaded from the [Releases](https://github.com/fboulnois/llm-leaderboard-csv/releases) page.
Previously, CSVs were also generated for the v1 and v2 [Huggingface Open LLM Leaderboard](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) in R but this leaderboard has been retired. The latest code and versions of those CSVs is in the [`v1.3.0` release](https://github.com/fboulnois/llm-leaderboard-csv/releases/v1.3.0).
## Run
> [!TIP]
> Delete the `csv` directory before running the code if you want to recreate the CSVs using the latest data.
### Run using Python
The code is in [`huggingface.py`](huggingface.py):
```sh
# run the code to generate the leaderboard data frames
uv run huggingface.py
```
### Run using Docker
A [`Dockerfile`](Dockerfile) is also provided to build and run the code using the official `uv` Docker image:
```bash
docker build . --tag llm-leaderboard-csv
docker run -v ./csv:/home/uv/csv --rm llm-leaderboard-csv
```