https://github.com/AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI
https://github.com/AgentOps-AI/agentops
agent agentops agents-sdk ai anthropic autogen cost-estimation crewai evals evaluation-metrics groq langchain llm mistral ollama openai openai-agents
Last synced: 19 days ago
JSON representation
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI
- Host: GitHub
- URL: https://github.com/AgentOps-AI/agentops
- Owner: AgentOps-AI
- License: mit
- Created: 2023-08-15T23:26:23.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-25T19:19:13.000Z (20 days ago)
- Last Synced: 2025-03-25T20:01:35.481Z (20 days ago)
- Topics: agent, agentops, agents-sdk, ai, anthropic, autogen, cost-estimation, crewai, evals, evaluation-metrics, groq, langchain, llm, mistral, ollama, openai, openai-agents
- Language: Python
- Homepage: https://agentops.ai
- Size: 143 MB
- Stars: 4,107
- Watchers: 43
- Forks: 367
- Open Issues: 87
-
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: .github/CODE_OF_CONDUCT.md
Awesome Lists containing this project
- StarryDivineSky - AgentOps-AI/agentops
- Awesome-AI-Agents - agentops - Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen  (Benchmark/Evaluator / Advanced Components)
- Awesome-AI-Agents - agentops - Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen  (Benchmark/Evaluator / Advanced Components)
- jimsghstars - AgentOps-AI/agentops - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Langchain, Autogen, AG2, and CamelAI (Python)
- awesome_ai_agents - Agentops - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI… (Building / Benchmarks)
- awesome_ai_agents - Agentops - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI… (Building / Benchmarks)
- awesome-production-machine-learning - AgentOps - AI/agentops.svg?style=social) - AgentOps helps developers build, evaluate, and monitor AI agents from prototype to production. (Agentic Framework)