https://github.com/mattpocock/evalite

Test your LLM-powered apps with TypeScript. No API key required.
https://github.com/mattpocock/evalite

ai evals typescript

Last synced: 15 days ago
JSON representation

Test your LLM-powered apps with TypeScript. No API key required.

• Host: GitHub
• URL: https://github.com/mattpocock/evalite
• Owner: mattpocock
• License: mit
• Created: 2024-11-12T13:00:20.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2025-04-18T12:50:03.000Z (20 days ago)
• Last Synced: 2025-04-18T17:28:10.773Z (20 days ago)
• Topics: ai, evals, typescript
• Language: TypeScript
• Homepage: https://www.evalite.dev/
• Size: 2.21 MB
• Stars: 528
• Watchers: 13
• Forks: 20
• Open Issues: 34
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![Evalite: the TypeScript-native, local-first tool for testing LLM-powered apps.](https://raw.githubusercontent.com/mattpocock/evalite/refs/heads/main/repo-card.jpg)

- [View the docs](https://www.evalite.dev/)

- [Join the Discord](https://www.mattpocock.com/ai-discord)

## Contributing

1. Create a .env file inside `packages/example` containing an `OPENAI_API_KEY`:

```sh

OPENAI_API_KEY=your-api-key

```

2. Run `pnpm run dev`. This will:

- Run the TS type checker on `evalite`, `evalite-core`

- Run some tests at `evalite-tests`

- Run the UI dev server at http://localhost:5173

- Run `evalite watch` on the examples in `packages/example`

> [!IMPORTANT]

>

> You may need to run `pnpm build` in root, then `npm link` inside `packages/evalite` to get the global `evalite` command to work.