https://github.com/athina-ai/athina-evals

Python SDK for running evaluations on LLM generated responses
https://github.com/athina-ai/athina-evals

evaluation evaluation-framework evaluation-metrics llm-eval llm-evaluation llm-evaluation-toolkit llm-ops llmops

Last synced: about 2 months ago
JSON representation

Python SDK for running evaluations on LLM generated responses

• Host: GitHub
• URL: https://github.com/athina-ai/athina-evals
• Owner: athina-ai
• Created: 2023-11-22T10:46:44.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-05-22T07:52:29.000Z (4 months ago)
• Last Synced: 2024-05-22T15:16:29.360Z (4 months ago)
• Topics: evaluation, evaluation-framework, evaluation-metrics, llm-eval, llm-evaluation, llm-evaluation-toolkit, llm-ops, llmops
• Language: Python
• Homepage: https://docs.athina.ai
• Size: 1.01 MB
• Stars: 139
• Watchers: 5
• Forks: 11
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-llm-eval - athina-ai - ai是一个开源库，提供即插即用的预设评估（preset evals）/模块化、可扩展的框架来编写和运行评估，帮助工程师通过评估驱动的开发来系统性地提高他们的大型语言模型的可靠性和性能，athina-ai提供了一个系统，用于评估驱动的开发，克服了传统工作流程的限制，允许快速实验和具有一致指标的可定制评估器 | (Tools)