https://github.com/victoralfred/whatifd
whatif is an open experiment runner for LLM behavior changes. whatif forks production traces, replays them with a proposed change (cached tool outputs preserve safety), scores the diff, and emits a PR-ready verdict report
https://github.com/victoralfred/whatifd
ai aiops genai llm llm-observability llmops llms mlops mlops-workflow open-source prompt-engineering
Last synced: about 1 month ago
JSON representation
whatif is an open experiment runner for LLM behavior changes. whatif forks production traces, replays them with a proposed change (cached tool outputs preserve safety), scores the diff, and emits a PR-ready verdict report
- Host: GitHub
- URL: https://github.com/victoralfred/whatifd
- Owner: victoralfred
- License: apache-2.0
- Created: 2026-05-03T10:47:41.000Z (about 2 months ago)
- Default Branch: main
- Last Pushed: 2026-05-08T20:16:49.000Z (about 2 months ago)
- Last Synced: 2026-05-08T21:33:10.829Z (about 2 months ago)
- Topics: ai, aiops, genai, llm, llm-observability, llmops, llms, mlops, mlops-workflow, open-source, prompt-engineering
- Language: Python
- Homepage: https://whatif.codes
- Size: 5.76 MB
- Stars: 0
- Watchers: 0
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: .github/CODEOWNERS
- Security: SECURITY.md