https://github.com/gpt-fathom/gpt-fathom

GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings.
https://github.com/gpt-fathom/gpt-fathom

Last synced: 3 months ago
JSON representation

GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings.

• Host: GitHub
• URL: https://github.com/gpt-fathom/gpt-fathom
• Owner: GPT-Fathom
• License: mit
• Created: 2023-09-28T22:36:25.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-10T19:41:25.000Z (7 months ago)
• Last Synced: 2024-06-16T23:35:49.953Z (5 months ago)
• Language: Python
• Homepage:
• Size: 78.1 MB
• Stars: 343
• Watchers: 1
• Forks: 23
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

• awesome-ChatGPT-repositories - GPT-Fathom - GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings. (NLP)