https://github.com/langfuse/oss-llmops-stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
https://github.com/langfuse/oss-llmops-stack

ai-gateway gateway llm llm-evaluation llm-gateway llm-observability llmops monitoring open-source openai-proxy prompt-management self-hosted ycombinator

Last synced: 2 months ago
JSON representation

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

• Host: GitHub
• URL: https://github.com/langfuse/oss-llmops-stack
• Owner: langfuse
• License: mit
• Created: 2025-02-08T16:59:06.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-02-14T16:11:36.000Z (over 1 year ago)
• Last Synced: 2025-02-14T16:34:17.951Z (over 1 year ago)
• Topics: ai-gateway, gateway, llm, llm-evaluation, llm-gateway, llm-observability, llmops, monitoring, open-source, openai-proxy, prompt-management, self-hosted, ycombinator
• Homepage: https://oss-llmops-stack.com
• Size: 316 KB
• Stars: 5
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# OSS LLMOps Stack

> [!NOTE]  

> Learn more: [oss-llmops-stack.com](https://oss-llmops-stack.com)