https://github.com/tmc/pe
prompt engineering tools, specifications, and more.
https://github.com/tmc/pe
Last synced: over 1 year ago
JSON representation
prompt engineering tools, specifications, and more.
- Host: GitHub
- URL: https://github.com/tmc/pe
- Owner: tmc
- Created: 2024-11-08T08:51:11.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2025-03-02T09:53:31.000Z (over 1 year ago)
- Last Synced: 2025-03-02T10:28:54.617Z (over 1 year ago)
- Language: Go
- Homepage:
- Size: 23.4 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# pe
pe is a collection of tools for working with prompt engineering concepts, files, and tools.
## Tools
* [pfutil](cmd/pfutil): operations on promptfoo configuration files
* `vet`: validate promptfoo configuration files
* `fmt`: format promptfoo configuration files
* `convert`: convert promptfoo configuration files between formats (yaml, json)
* `run`: execute promptfoo configuration files against LLM providers (with mock implementations)
* Scripts:
* `scripts/test-convert.sh`: simple test for format conversion roundtrips
* `scripts/test-semantic-equality.sh`: comprehensive test for data integrity during format conversions
## Specifications
* [prompt_engineering.proto](./prompt_engineering.proto): Protobuf definitions for prompt
engineering concepts.
## Download/Install
The easiest way to install is to run `go install github.com/tmc/pe/cmd/...@latest`.
You can also clone the repository and run `go install ./cmd/...`.
## Contribute
Contributions to pe are welcome. Before submitting a pull request, please make
sure tests pass:
```
# Run Go tests
go test ./...
# Test the pfutil tool's format conversion functionality
./scripts/test-semantic-equality.sh
```
## Report Issues / Send Patches
https://github.com/tmc/pe/issues.