https://github.com/mattpocock/evalite

Test your LLM-powered apps with TypeScript. No API key required.
https://github.com/mattpocock/evalite

ai evals typescript

Last synced: 2 months ago
JSON representation

Test your LLM-powered apps with TypeScript. No API key required.

• Host: GitHub
• URL: https://github.com/mattpocock/evalite
• Owner: mattpocock
• Created: 2024-11-12T13:00:20.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-12-16T11:16:36.000Z (2 months ago)
• Last Synced: 2024-12-16T11:38:58.349Z (2 months ago)
• Topics: ai, evals, typescript
• Language: TypeScript
• Homepage: https://www.aihero.dev/evalite-an-early-preview
• Size: 1.11 MB
• Stars: 208
• Watchers: 13
• Forks: 5
• Open Issues: 12
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
![Evalite: the TypeScript-native, local-first tool for testing LLM-powered apps.](https://raw.githubusercontent.com/mattpocock/evalite/refs/heads/main/repo-card.jpg)

- [View the docs](https://www.evalite.dev/)

- [Join the Discord](https://www.mattpocock.com/ai-discord)

## Contributing

1. Create a .env file inside `packages/example` containing an `OPENAI_API_KEY`:

```sh

OPENAI_API_KEY=your-api-key

```

2. Run `pnpm run dev`. This will:

- Run the TS type checker on `evalite`, `evalite-core`

- Run some tests at `evalite-tests`

- Run the UI dev server at http://localhost:5173

- Run `evalite watch` on the examples in `packages/example`

> [!IMPORTANT]

>

> You may need to run `pnpm build` in root, then `npm link` inside `packages/evalite` to get the global `evalite` command to work.