https://github.com/lunary-ai/lunary
The production toolkit for LLMs. Observability, prompt management and evaluations.
https://github.com/lunary-ai/lunary
ai evaluation hacktoberfest langchain llm logs monitoring observability openai prompts self-hosted testing
Last synced: 5 days ago
JSON representation
The production toolkit for LLMs. Observability, prompt management and evaluations.
- Host: GitHub
- URL: https://github.com/lunary-ai/lunary
- Owner: lunary-ai
- License: apache-2.0
- Created: 2023-05-12T10:03:05.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-03-26T22:21:27.000Z (20 days ago)
- Last Synced: 2025-04-03T02:24:47.824Z (13 days ago)
- Topics: ai, evaluation, hacktoberfest, langchain, llm, logs, monitoring, observability, openai, prompts, self-hosted, testing
- Language: TypeScript
- Homepage: https://lunary.ai
- Size: 5.58 MB
- Stars: 1,251
- Watchers: 4
- Forks: 150
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-production-machine-learning - LLMonitor - ai/lunary.svg?style=social) - LLMonitor is an observability & analytics for AI apps and agents. (Evaluation and Monitoring)
- awesome-ChatGPT-repositories - lunary - The production toolkit for LLMs. Observability, prompt management and evaluations. (Prompts)
- awesome-llmops - Lunary - and-play integration into LangChain. |  | (LLMOps / Observability)
README
# lunary
**Toolkit for LLM chatbots**
[website](https://lunary.ai) - [docs](https://lunary.ai/docs) - [llm sdk](https://github.com/lunary-ai/abso)
[](https://badge.fury.io/js/lunary)   
## Features
Lunary helps developers of LLM Chatbots develop and improve them.
- 🖲️ Conversation & feedback tracking
- 💵 Analytics (costs, token, latency, ..)
- 🔍 Debugging (logs, traces, user tracking, ..)
- ⛩️ Prompt Directory (versioning, team collaboration, ..)
- 🏷️ Datasets (for evaluation, fine-tuning, ..)
- 🧪 Topic & sentiment analysis
It also designed to be:
- 📝 Easy to use
- 📦 Fast to integrate (2 minutes)
- 🧑💻 Self-hostable
## 1-min Demo
https://github.com/user-attachments/assets/4f95d952-a89b-442b-854a-e71e036073bb
## ⚙️ Integration
Modules available for:
- [JavaScript](https://github.com/lunary-ai/lunary-js)
- [Python](https://github.com/lunary-ai/lunary-py)
Lunary natively supports:
- [Abso](https://github.com/lunary-ai/abso)
- [LangChain](https://lunary.ai/docs/langchain) (JS & Python)
- [OpenAI module](https://lunary.ai/docs/js/openai)
- [LiteLLM](https://docs.litellm.ai/docs/observability/lunary_integration)
- [Flowise](https://lunary.ai/docs/integrations/flowise)
Additionally you can use it with any other LLM by manually sending events.
## 📚 Documentation
Full documentation is available [on the website](https://lunary.ai/docs/).
## ☁️ Hosted version
We offer [a hosted version](https://lunary.ai) with a generous free tier.
With the hosted version:
- 👷 don't worry about devops or managing updates
- 🙋 get priority 1:1 support with our team
- 🇪🇺 your data is stored safely in Europe
## Running locally
1. Clone the repository
2. Setup a PostgreSQL instance (version 15 minimum)
3. Copy the content of `packages/backend/.env.example` to `packages/backend/.env` and fill the missing values
4. Copy the content of `packages/frontend/.env.example` to `packages/frontend/.env` and fill the missing values
5. Run `bun install`
6. Run `bun run migrate:db`
7. Run `bun run dev`
You can now open the dashboard at `http://localhost:8080`.
When using our JS or Python SDK, you need to set the environment variable `LUNARY_API_URL` to `http://localhost:3333`. You can use `LUNARY_VERBOSE=True` to see all the event sent by the SDK
## 🙋 Support
Need help or have questions? Chat with us on [the website](https://lunary.ai) or email us: [hello [at] lunary.ai](mailto:[email protected]). We're here to help every step of the way.
## License
This project is licensed under the Apache 2.0 License.