https://github.com/tatsu-lab/alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
https://github.com/tatsu-lab/alpaca_eval

deep-learning evaluation foundation-models instruction-following large-language-models leaderboard nlp rlhf

Last synced: 25 days ago
JSON representation

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

• Host: GitHub
• URL: https://github.com/tatsu-lab/alpaca_eval
• Owner: tatsu-lab
• License: apache-2.0
• Created: 2023-05-25T09:35:28.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-13T23:10:24.000Z (7 months ago)
• Last Synced: 2024-04-14T13:19:19.584Z (7 months ago)
• Topics: deep-learning, evaluation, foundation-models, instruction-following, large-language-models, leaderboard, nlp, rlhf
• Language: Jupyter Notebook
• Homepage: https://tatsu-lab.github.io/alpaca_eval/
• Size: 190 MB
• Stars: 1,062
• Watchers: 9
• Forks: 156
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Citation: CITATION.cff

Awesome Lists containing this project

• Awesome-LLMs-Evaluation-Papers - [Github
• awesome-llm-eval - alpaca_eval - lab开发的一个用于评估LLM的工具，可以使用多种语言、领域和任务进行测试，并提供可解释性、鲁棒性和可信度等指标. | (Tools)
• StarryDivineSky - tatsu-lab/alpaca_eval
• awesome-production-machine-learning - AlpacaEval - lab/alpaca_eval.svg?style=social) - AlpacaEval is an automatic evaluator for instruction-following language models. (Evaluation and Monitoring)
• awesome-llm-if - alpaca_eval - lab/alpaca_eval.svg) (Uncategorized / Uncategorized)
• awesome-llm-if - alpaca_eval - lab/alpaca_eval.svg) (Uncategorized / Uncategorized)