https://github.com/google/BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
https://github.com/google/BIG-bench

Last synced: 30 days ago
JSON representation

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

• Host: GitHub
• URL: https://github.com/google/BIG-bench
• Owner: google
• License: apache-2.0
• Created: 2021-01-15T23:28:20.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2024-07-19T11:57:37.000Z (9 months ago)
• Last Synced: 2025-03-13T06:55:09.567Z (about 1 month ago)
• Language: Python
• Homepage:
• Size: 897 MB
• Stars: 2,989
• Watchers: 48
• Forks: 599
• Open Issues: 107
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE
  • Code of conduct: docs/code-of-conduct.md

Awesome Lists containing this project

• Awesome-Reasoning-Foundation-Models - [Code
• Awesome_Multimodel_LLM - Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
• StarryDivineSky - google/BIG-bench - bench 中包含的 200 多个任务。 (A01_文本生成_文本对话 / 大语言对话模型及数据)
• awesome-llm - BIG-bench
• awesome-llm-eval - BIG-bench
• awesome-generative-ai - google/BIG-bench
• Awesome-LLM - Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
• awesome-text-ml - BIG-bench - Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models. (Frameworks and libraries / :snake: Python)
• awesome-foundation-model-leaderboards - BBL - bench Lite) is a small subset of 24 diverse JSON tasks from BIG-bench. It is designed to provide a canonical measure of model performance, while being far cheaper to evaluate than the full set of more than 200 programmatic and JSON tasks in BIG-bench. | (Model Ranking / Text)
• awesome-golang-ai - BIG-bench