https://tatsu-lab.github.io/alpaca_eval/

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
https://tatsu-lab.github.io/alpaca_eval/

deep-learning evaluation foundation-models instruction-following large-language-models leaderboard nlp rlhf

Last synced: 22 days ago
JSON representation

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Host: GitHub
URL: https://tatsu-lab.github.io/alpaca_eval/
Owner: tatsu-lab
License: apache-2.0
Created: 2023-05-25T09:35:28.000Z (almost 2 years ago)
Default Branch: main
Last Pushed: 2024-12-27T21:47:41.000Z (4 months ago)
Last Synced: 2025-03-17T01:44:33.557Z (29 days ago)
Topics: deep-learning, evaluation, foundation-models, instruction-following, large-language-models, leaderboard, nlp, rlhf
Language: Jupyter Notebook
Homepage: https://tatsu-lab.github.io/alpaca_eval/
Size: 302 MB
Stars: 1,684
Watchers: 9
Forks: 261
Open Issues: 10
Metadata Files:
- Readme: README.md
- License: LICENSE
- Citation: CITATION.cff

awesome-local-ai - AlpacaEval Leaderboard - An Automatic Evaluator for Instruction-following Language Models. (LLM Leaderboard)
Awesome-LLMs-Evaluation-Papers - [Source
awesome-mlvid - AlpacaEval Leaderboard - An Automatic Evaluator for Instruction-following Language Models (Open LLM / Weakly-supervised learning)
awesome-LLMs-finetuning - AlpacaEval Leaderboard - An Automatic Evaluator for Instruction-following Language Models (1. LLM Performance & Concepts)
awesome-llm-list - AlpacaEval Leaderboard
awesome-llm-eval - [Source
Awesome-LLM - AlpacaEval - An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite. (LLM Leaderboard)
awesome-colab-project - AlpacaEval
awesome-ai-papers - [AlpacaEval Leaderboard - lab/alpaca_eval)\] (NLP / 3. Pretraining)
awesome-ai-papers - [AlpacaEval Leaderboard - lab/alpaca_eval)\] (NLP / 3. Pretraining)

ecosyste.ms