https://github.com/GAIR-NLP/auto-j

Generative Judge for Evaluating Alignment
https://github.com/GAIR-NLP/auto-j

Last synced: 3 months ago
JSON representation

Generative Judge for Evaluating Alignment

• Host: GitHub
• URL: https://github.com/GAIR-NLP/auto-j
• Owner: GAIR-NLP
• Created: 2023-10-01T02:21:59.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-18T02:37:17.000Z (10 months ago)
• Last Synced: 2024-06-14T01:57:13.209Z (5 months ago)
• Language: Python
• Homepage: https://gair-nlp.github.io/auto-j/
• Size: 26 MB
• Stars: 185
• Watchers: 5
• Forks: 10
• Open Issues: 6
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• StarryDivineSky - GAIR-NLP/auto-j - J 基于来自真实世界用户查询的数据和来自各种LLMs响应的数据进行训练，涵盖 58 个真实世界场景。灵活性：Auto-J 支持成对响应比较和单响应评估，只需切换到相应的提示即可。可解释性：Auto-J 提供详细的自然语言评论，可提高其评估结果的可靠性，并促进人类参与评估循环。 (文本生成、文本对话 / 大语言对话模型及数据)