https://github.com/AgentOps-AI/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI
https://github.com/AgentOps-AI/agentops

agent agentops agents-sdk ai anthropic autogen cost-estimation crewai evals evaluation-metrics groq langchain llm mistral ollama openai openai-agents

Last synced: 8 months ago
JSON representation

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

• Host: GitHub
• URL: https://github.com/AgentOps-AI/agentops
• Owner: AgentOps-AI
• License: mit
• Created: 2023-08-15T23:26:23.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-03-25T19:19:13.000Z (8 months ago)
• Last Synced: 2025-03-25T20:01:35.481Z (8 months ago)
• Topics: agent, agentops, agents-sdk, ai, anthropic, autogen, cost-estimation, crewai, evals, evaluation-metrics, groq, langchain, llm, mistral, ollama, openai, openai-agents
• Language: Python
• Homepage: https://agentops.ai
• Size: 143 MB
• Stars: 4,107
• Watchers: 43
• Forks: 367
• Open Issues: 87
• Metadata Files:
  • Readme: README.md
  • Contributing: .github/CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: .github/CODE_OF_CONDUCT.md

Awesome Lists containing this project

• StarryDivineSky - AgentOps-AI/agentops
• awesome-production-genai - AgentOps - AI/agentops.svg?style=social) - AgentOps helps developers build, evaluate, and monitor AI agents from prototype to production. (Agent Development)
• Awesome-AI-Agents - agentops - Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen  (Benchmark/Evaluator / Advanced Components)
• awesome-production-machine-learning - AgentOps - AI/agentops.svg?style=social) - AgentOps helps developers build, evaluate, and monitor AI agents from prototype to production. (Agentic Framework)
• awesome_ai_agents - Agentops - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI… (Building / Benchmarks)
• awesome-ai-agents - AgentOps - AI/agentops) | Monitoring, cost tracking, and benchmarking SDK for agents | (🌟 Core Frameworks)
• jimsghstars - AgentOps-AI/agentops - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Langchain, Autogen, AG2, and CamelAI (Python)