An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with prompt-testing

A curated list of projects in awesome lists tagged with prompt-testing .

https://github.com/promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

ci ci-cd cicd evaluation evaluation-framework llm llm-eval llm-evaluation llm-evaluation-framework llmops pentesting prompt-engineering prompt-testing prompts rag red-teaming testing vulnerability-scanners

Last synced: 14 Mar 2025

https://github.com/sigmakib2/openai-prompt-testing-playground

A dynamic and interactive playground for testing and refining prompts with OpenAI's language models. Includes customizable inputs for prompts, advanced model settings, and live response streaming for seamless experimentation.

ai chatgpt openai playground prompt prompt-engineering prompt-testing

Last synced: 12 Mar 2025

https://github.com/prompt-foundry/typescript-sdk

The Typescript SDK for the prompt engineering, prompt management, and prompt testing tool Prompt Foundry

llm-eval llm-evaluation llm-test open-ai prompt-engineering prompt-evaluation prompt-management prompt-manager prompt-testing typescript

Last synced: 31 Mar 2025

https://github.com/yukinagae/promptfoo-sample

Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models

evaluation evaluation-framework llm llm-eval llm-evaluation llm-evaluation-framework llmops prompt-testing promptfoo prompts testing

Last synced: 09 Apr 2025