https://github.com/fboulnois/llm-leaderboard-csv

CSVs of the Huggingface and LMSYS LLM leaderboards, along with the code to generate them in R.
https://github.com/fboulnois/llm-leaderboard-csv

chatgpt csv huggingface llama llama2 llama3 llm lmsys mistral open-llm-leaderboard openai r

Last synced: 20 days ago
JSON representation

CSVs of the Huggingface and LMSYS LLM leaderboards, along with the code to generate them in R.

• Host: GitHub
• URL: https://github.com/fboulnois/llm-leaderboard-csv
• Owner: fboulnois
• License: mpl-2.0
• Created: 2024-06-19T13:48:23.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-12-16T11:19:37.000Z (26 days ago)
• Last Synced: 2024-12-16T12:25:19.956Z (26 days ago)
• Topics: chatgpt, csv, huggingface, llama, llama2, llama3, llm, lmsys, mistral, open-llm-leaderboard, openai, r
• Language: R
• Homepage:
• Size: 3.75 MB
• Stars: 6
• Watchers: 0
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LLM Leaderboard CSVs

Generate CSVs of the [Huggingface Open LLM Leaderboard](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)

(v1 and v2), the [LMSYS Chatbot Arena Leaderboard](https://chat.lmsys.org/?leaderboard),

and the merged leaderboard in R.

The latest CSVs can be downloaded from the [Releases](https://github.com/fboulnois/llm-leaderboard-csv/releases) page.

## Run

> [!TIP]

> Delete the `csv` directory before running the code if you want to recreate the

CSVs using the latest data.

### Run using R or RStudio

The code is in [`huggingface.R`](huggingface.R):

```R

# install the required dependencies

install.packages(c("data.table", "rvest", "stringr", "jsonlite"))

# run the code to generate the leaderboard data.tables

source("huggingface.R")

```

### Run using Docker

A [`Dockerfile`](Dockerfile) is also provided to build and run the code using

the official `r-base` Docker image:

```bash

docker build . --tag llm-leaderboard-csv

docker run -v ./csv:/home/docker/csv --rm llm-leaderboard-csv

```