Projects in Awesome Lists tagged with llm-monitoring
A curated list of projects in awesome lists tagged with llm-monitoring .
https://github.com/agenta-ai/agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
llm-as-a-judge llm-evaluation llm-framework llm-monitoring llm-observability llm-platform llm-playground llm-tools llmops-platform prompt-engineering prompt-management rag-evaluation
Last synced: 12 May 2025
https://github.com/pyladiesams/eval-llm-based-apps-jan2025
Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.
llm llm-eval llm-evals llm-evaluation-framework llm-evaluation-metrics llm-monitoring llm-test llm-testing llmops llms workshop
Last synced: 12 May 2025
https://github.com/aygp-dr/nexushive-agent-insights
Enterprise-grade observability for AI agents using OpenTelemetry
agent-observability ai-agents llm-monitoring opentelemetry smolagents telemetry
Last synced: 29 Mar 2025
https://github.com/kyopark2014/llm-monitoring
It shows how to monitoring LLM.
amazon-bedrock dashboard llm-monitoring token-logger
Last synced: 30 Mar 2025
