Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/pezzolabs/pezzo

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
https://github.com/pezzolabs/pezzo

ai devtools gpt-3 gpt-4 hacktoberfest javascript langchain llm llmops monitoring nestjs nodejs observability openai platform prompt prompt-engineering prompt-management python typescript

Last synced: 6 days ago
JSON representation

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Host: GitHub
URL: https://github.com/pezzolabs/pezzo
Owner: pezzolabs
License: apache-2.0
Created: 2023-04-22T20:54:10.000Z (almost 2 years ago)
Default Branch: main
Last Pushed: 2024-11-20T14:06:03.000Z (3 months ago)
Last Synced: 2024-12-03T09:17:00.883Z (2 months ago)
Topics: ai, devtools, gpt-3, gpt-4, hacktoberfest, javascript, langchain, llm, llmops, monitoring, nestjs, nodejs, observability, openai, platform, prompt, prompt-engineering, prompt-management, python, typescript
Language: TypeScript
Homepage: https://pezzo.ai
Size: 28.9 MB
Stars: 2,550
Watchers: 26
Forks: 211
Open Issues: 39
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

Awesome-LLM-Productization - Pezzo - Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more. (Models and Tools / LLM Prompt Management)
awesome-llmops - Pezzo 🕹️ - source LLMOps platform built for developers and teams. In just two lines of code, you can seamlessly troubleshoot your AI operations, collaborate and manage your prompts in one place, and instantly deploy changes to any environment. | ![GitHub Badge](https://img.shields.io/github/stars/pezzolabs/pezzo.svg?style=flat-square) | (LLMOps / Observability)
awesome-llm-eval - Pezzo 🕹️
StarryDivineSky - pezzolabs/pezzo
jimsghstars - pezzolabs/pezzo - 🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more. (TypeScript)
awesome-ChatGPT-repositories - pezzo - 🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more. (Prompts)

README

Pezzo is a fully cloud-native and open-source LLMOps platform. Seamlessly observe and monitor your AI operations, troubleshoot issues, save up to 90% on costs and latency, collaborate and manage your prompts in one place, and instantly deliver AI changes.

# ✨ Features

# Documentation

[Click here to navigate to the Official Pezzo Documentation](https://docs.pezzo.ai/)

In the documentation, you can find information on how to use Pezzo, its architecture, including tutorials and recipes for varius use cases and LLM providers.

# Supported Clients

Feature

Node.js
•
Docs

Python
•
Docs

LangChain

Prompt Management
✅
✅
✅

Observability
✅
✅
✅

Caching
✅
✅
✅

Looking for a client that's not listed here? [Open an issue](https://github.com/pezzolabs/pezzo/issues/new/choose) and let us know!

# Getting Started - Docker Compose

If you simply want to run the full Pezzo stack locally, check out [Running With Docker Compose](http://docs.pezzo.ai/introduction/docker-compose) in the documentation.

If you want to run Pezzo in development mode, continue reading.

### Prerequisites

- Node.js 18+
- Docker
- (Recommended) [GraphQL Language Feature Support VSCode Extension](https://marketplace.visualstudio.com/items?itemName=GraphQL.vscode-graphql)

### Install dependencies

Install NPM dependencies by running:

```
npm install
```

### Set up the environment files

Pezzo uses a .env file to store environment variables.
When using docker, you should also create a .env.docker file.

See the .env.example file for reference.

### Spin up infrastructure dependencies via Docker Compose

Pezzo is entirely cloud-native and relies solely on open-source technologies such as [PostgreSQL](https://www.postgresql.org/), [ClickHouse](https://github.com/ClickHouse/ClickHouse), [Redis](https://github.com/redis/redis) and [Supertokens](https://supertokens.com/).

You can run these dependencies via Docker Compose:

```
docker-compose -f docker-compose.infra.yaml up
```

### Start Pezzo

Deploy Prisma migrations:

```
npx dotenv-cli -e apps/server/.env -- npx prisma migrate deploy --schema apps/server/prisma/schema.prisma
```

Run the server:

```
npx nx serve server
```

The server is now running. You can verify that by navigating to http://localhost:3000/api/healthz.

In development mode, you want to run `codegen` in watch mode, so whenever you make changes to the schema, types are generated automatically. After running the server, run the following in a _separate terminal Window_:

```
npm run graphql:codegen:watch
```

This will connect [codegen](https://the-guild.dev/graphql/codegen/docs/getting-started) directly to the server and keep your GraphQL schema up-to-date as you make changes.

Finally, you are ready to run the Pezzo Console:

```
npx nx serve console
```

That's it! The Pezzo Console is now accessible at http://localhost:4200 🚀

# Contributing

We welcome contributions from the community! Please feel free to submit pull requests or create issues for bugs or feature suggestions.

If you want to contribute but not sure how, join our [Discord](https://pezzo.cc/discord) and we'll be happy to help you out!

Please check out [CONTRIBUTING.md](CONTRIBUTING.md) before contributing.

# License

This repository's source code is available under the [Apache 2.0 License](LICENSE).