https://github.com/google/BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
https://github.com/google/BIG-bench

Last synced: about 2 months ago
JSON representation

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

• Host: GitHub
• URL: https://github.com/google/BIG-bench
• Owner: google
• License: apache-2.0
• Created: 2021-01-15T23:28:20.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2024-07-19T11:57:37.000Z (5 months ago)
• Last Synced: 2024-10-16T09:41:48.079Z (about 2 months ago)
• Language: Python
• Homepage:
• Size: 897 MB
• Stars: 2,842
• Watchers: 51
• Forks: 587
• Open Issues: 107
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE
  • Code of conduct: docs/code-of-conduct.md

Awesome Lists containing this project

• Awesome-Reasoning-Foundation-Models - [Code
• Awesome_Multimodel_LLM - Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
• awesome-llm - BIG-bench
• awesome-llm-eval - BIG-bench
• awesome-generative-ai - google/BIG-bench
• Awesome-LLM - Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
• awesome-text-ml - BIG-bench - Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models. (Frameworks and libraries / :snake: Python)
• StarryDivineSky - google/BIG-bench - bench 中包含的 200 多个任务。 (A01_文本生成_文本对话 / 大语言对话模型及数据)
• awesome-foundation-model-leaderboards - BBL - bench Lite) is a small subset of 24 diverse JSON tasks from BIG-bench. It is designed to provide a canonical measure of model performance, while being far cheaper to evaluate than the full set of more than 200 programmatic and JSON tasks in BIG-bench. | (Model Ranking / Text)