https://github.com/discourse/discourse-ai

https://github.com/discourse/discourse-ai

ai aws-bedrock chatgpt claude-ai discourse-plugin huggingface llama2 openai workers-ai

Last synced: 3 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/discourse/discourse-ai
• Owner: discourse
• License: mit
• Created: 2023-02-17T14:33:44.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-10-29T13:09:04.000Z (8 months ago)
• Last Synced: 2024-10-29T13:28:39.926Z (8 months ago)
• Topics: ai, aws-bedrock, chatgpt, claude-ai, discourse-plugin, huggingface, llama2, openai, workers-ai
• Language: Ruby
• Homepage: https://meta.discourse.org/t/discourse-ai/259214?u=falco
• Size: 12.2 MB
• Stars: 67
• Watchers: 18
• Forks: 22
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# **Discourse AI** Plugin

**Plugin Summary**

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco

### Evals

The directory `evals` contains AI evals for the Discourse AI plugin. 

You may create a local config by copying `config/eval-llms.yml` to `config/eval-llms.local.yml` and modifying the values.

To run them use: 

cd evals

./run --help

```

Usage: evals/run [options]

    -e, --eval NAME                  Name of the evaluation to run

        --list-models                List models

    -m, --model NAME                 Model to evaluate (will eval all models if not specified)

    -l, --list                       List evals

```

To run evals you will need to configure API keys in your environment:

OPENAI_API_KEY=your_openai_api_key

ANTHROPIC_API_KEY=your_anthropic_api_key

GEMINI_API_KEY=your_gemini_api_key