Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/lunary-ai/lunary
The production toolkit for LLMs. Observability, prompt management and evaluations.
https://github.com/lunary-ai/lunary
ai evaluation hacktoberfest langchain llm logs monitoring observability openai prompts self-hosted testing
Last synced: 24 days ago
JSON representation
The production toolkit for LLMs. Observability, prompt management and evaluations.
- Host: GitHub
- URL: https://github.com/lunary-ai/lunary
- Owner: lunary-ai
- License: apache-2.0
- Created: 2023-05-12T10:03:05.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-09-12T08:01:33.000Z (about 2 months ago)
- Last Synced: 2024-09-12T11:16:29.898Z (about 2 months ago)
- Topics: ai, evaluation, hacktoberfest, langchain, llm, logs, monitoring, observability, openai, prompts, self-hosted, testing
- Language: TypeScript
- Homepage: https://lunary.ai
- Size: 4.15 MB
- Stars: 1,017
- Watchers: 7
- Forks: 119
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-production-machine-learning - LLMonitor - ai/lunary.svg?style=social) - LLMonitor is an observability & analytics for AI apps and agents. (Evaluation and Monitoring)
README
# lunary
**Developer toolkit for LLM chatbots**
[website](https://lunary.ai) - [docs](https://lunary.ai/docs)
[](https://badge.fury.io/js/lunary)   
## Features
Lunary helps developers of LLM Chatbots develop and improve them.
- 🖲️ Conversation & feedback tracking
- 💵 Analytics (costs, token, latency, ..)
- 🔍 Debugging (logs, traces, user tracking, ..)
- ⛩️ Prompt Directory (versioning, team collaboration, ..)
- 🏷️ Create fine-tuning datasets
- 🧪 Automatic topic classification
It also designed to be:
- 🤖 Usable with any model, not just OpenAI
- 📦 Easy to integrate (2 minutes)
- 🧑💻 Self-hostable
## 1-min Demo
https://github.com/lunary-ai/lunary/assets/5092466/a2b4ba9b-4afb-46e3-9b6b-faf7ddb4a931
## ⚙️ Integration
Modules available for:
- [JavaScript](https://github.com/lunary-ai/lunary-js)
- [Python](https://github.com/lunary-ai/lunary-py)
Lunary natively supports:
- [LangChain](https://lunary.ai/docs/langchain) (JS & Python)
- [OpenAI module](https://lunary.ai/docs/js/openai)
- [LiteLLM](https://docs.litellm.ai/docs/observability/lunary_integration)
- [Flowise](https://lunary.ai/docs/integrations/flowise)
Additionally you can use it with any other LLM by manually sending events.
## 📚 Documentation
Full documentation is available [on the website](https://lunary.ai/docs/intro).
## ☁️ Hosted version
We offer [a hosted version](https://lunary.ai) with a free plan of up to 10k requests / month.
With the hosted version:
- 👷 don't worry about devops or managing updates
- 🙋 get priority 1:1 support with our team
- 🇪🇺 your data is stored safely in Europe
## Running locally
1. Clone the repository
2. Setup a PostgreSQL instance (version 15 minimum)
3. Copy the content of `packages/backend/.env.example` to `packages/backend/.env` and fill the missing values
4. Copy the content of `packages/frontend/.env.example` to `packages/backend/.env`
5. Run `npm install`
6. Run `npm run migrate:db`
7. Run `npm run dev`
You can now open the dashboard at `http://localhost:8080`.
When using our JS or Python SDK, you need to set the environment variable `LUNARY_API_URL` to `http://localhost:3333`. You can use `LUNARY_VERBOSE=True` to see all the event sent by the SDK
## 🙋 Support
Need help or have questions? Chat with us on [the website](https://lunary.ai) or email us: [hello [at] lunary.ai](mailto:[email protected]). We're here to help every step of the way.
## License
This project is licensed under the Apache 2.0 License.