https://github.com/mattpocock/evalite

Test your LLM-powered apps with TypeScript. No API key required.
https://github.com/mattpocock/evalite

ai evals typescript

Last synced: 12 months ago
JSON representation

Test your LLM-powered apps with TypeScript. No API key required.

• Host: GitHub
• URL: https://github.com/mattpocock/evalite
• Owner: mattpocock
• License: mit
• Created: 2024-11-12T13:00:20.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-04-30T10:57:33.000Z (about 1 year ago)
• Last Synced: 2025-05-13T12:48:11.873Z (12 months ago)
• Topics: ai, evals, typescript
• Language: TypeScript
• Homepage: https://www.evalite.dev/
• Size: 1.36 MB
• Stars: 557
• Watchers: 12
• Forks: 23
• Open Issues: 32
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-github-projects - evalite - Evaluate your LLM-powered apps with TypeScript ⭐1,496 `TypeScript` 🔥 (🤖 AI & Machine Learning)

README

          
![Evalite: the TypeScript-native, local-first tool for testing LLM-powered apps.](https://raw.githubusercontent.com/mattpocock/evalite/refs/heads/main/repo-card.jpg)

- [View the docs](https://www.evalite.dev/)

- [Join the Discord](https://www.mattpocock.com/ai-discord)

## Contributing

1. Create a .env file inside `packages/example` containing an `OPENAI_API_KEY`:

```sh

OPENAI_API_KEY=your-api-key

```

2. Run `pnpm run dev`. This will:

- Run the TS type checker on `evalite`, `evalite-core`

- Run some tests at `evalite-tests`

- Run the UI dev server at http://localhost:5173

- Run `evalite watch` on the examples in `packages/example`

> [!IMPORTANT]

>

> You may need to run `pnpm build` in root, then `npm link` inside `packages/evalite` to get the global `evalite` command to work.