https://fasteval.github.io/FastEval/

Fast & more realistic evaluation of chat language models. Includes leaderboard.
https://fasteval.github.io/FastEval/

benchmark evaluation llm

Last synced: about 1 month ago
JSON representation

Fast & more realistic evaluation of chat language models. Includes leaderboard.

• Host: GitHub
• URL: https://fasteval.github.io/FastEval/
• Owner: FastEval
• License: apache-2.0
• Created: 2023-05-07T17:08:45.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-12-23T16:40:23.000Z (12 months ago)
• Last Synced: 2024-04-23T00:09:44.951Z (8 months ago)
• Topics: benchmark, evaluation, llm
• Language: Python
• Homepage: https://fasteval.github.io/FastEval/
• Size: 137 MB
• Stars: 157
• Watchers: 3
• Forks: 21
• Open Issues: 18
• Metadata Files:
  • Readme: README.md
  • Contributing: .github/CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-foundation-model-leaderboards - FastEval - following and chat language models on various benchmarks with fast inference and detailed performance insights. | (Model Ranking / Text)