{"id":48179999,"url":"https://github.com/chirpz-ai/pandaprobe","last_synced_at":"2026-06-04T00:00:33.522Z","repository":{"id":343365563,"uuid":"1117298172","full_name":"chirpz-ai/pandaprobe","owner":"chirpz-ai","description":"open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more. ","archived":false,"fork":false,"pushed_at":"2026-06-03T22:07:48.000Z","size":14995,"stargazers_count":256,"open_issues_count":15,"forks_count":16,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-06-03T23:14:20.507Z","etag":null,"topics":["agent-engineering","agent-evaluation","agent-observability","agentic-ai","claude-agent-sdk","crewai","langgraph","monitoring","open-source","openai-agents-sdk","self-hosted","tracing"],"latest_commit_sha":null,"homepage":"https://pandaprobe.com","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chirpz-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-12-16T05:45:30.000Z","updated_at":"2026-06-03T22:04:10.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/chirpz-ai/pandaprobe","commit_stats":null,"previous_names":["chirpz-ai/pandaprobe"],"tags_count":17,"template":false,"template_full_name":null,"purl":"pkg:github/chirpz-ai/pandaprobe","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chirpz-ai%2Fpandaprobe","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chirpz-ai%2Fpandaprobe/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chirpz-ai%2Fpandaprobe/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chirpz-ai%2Fpandaprobe/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chirpz-ai","download_url":"https://codeload.github.com/chirpz-ai/pandaprobe/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chirpz-ai%2Fpandaprobe/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33884734,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-03T02:00:06.370Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent-engineering","agent-evaluation","agent-observability","agentic-ai","claude-agent-sdk","crewai","langgraph","monitoring","open-source","openai-agents-sdk","self-hosted","tracing"],"created_at":"2026-04-04T17:43:33.583Z","updated_at":"2026-06-04T00:00:33.503Z","avatar_url":"https://github.com/chirpz-ai.png","language":"Python","funding_links":[],"categories":["*Ops for AI"],"sub_categories":["LLMOps"],"readme":"\u003cdiv align=\"center\"\u003e\n  \u003ca href=\"https://pandaprobe.com/\" target=\"_blank\" rel=\"noopener noreferrer\"\u003e\n    \u003cpicture\u003e\n      \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"docs/assets/logo-light.png\"\u003e\n      \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"docs/assets/logo-dark.png\"\u003e\n      \u003cimg alt=\"PandaProbe Logo\" src=\"docs/assets/logo-dark.png\" width=\"80%\"\u003e\n    \u003c/picture\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"docs/assets/heading.svg\" alt=\"open source agent engineering platform. By Chirpz AI\" width=\"700\"/\u003e\n\u003c/div\u003e\n\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://pandaprobe.com/\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/PandaProbe_Cloud-0066FF\" alt=\"PandaProbe Cloud\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://pandaprobe.com/\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/Docs-0066FF\" alt=\"Docs\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://x.com/PandaProbe\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/twitter/follow/PandaProbe?style=social\" alt=\"Follow on X\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://pypi.org/project/pandaprobe/\" alt=\"PyPI Downloads\"\u003e\u003cimg src=\"https://static.pepy.tech/badge/pandaprobe\" /\u003e\u003c/a\u003e\n  \u003ca href=\"LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/badge/License-Apache_2.0-blue.svg\" alt=\"License\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://www.pandaprobe.com/\" alt=\"Website\"\u003e\u003cimg src=\"https://img.shields.io/badge/made by-Chirpz AI-blue\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://discord.gg/A2VfrRhx\"\u003e\u003cimg src=\"https://img.shields.io/discord/1486405147893436426?label=Discord\u0026logo=discord\u0026logoColor=white\u0026style=flat-square\" alt=\"Discord\"\u003e\u003c/a\u003e\n  \u003cbr/\u003e\n  \u003ca href=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/build.yml\"\u003e\u003cimg src=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/build.yml/badge.svg\" alt=\"Build\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/lint.yml\"\u003e\u003cimg src=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/lint.yml/badge.svg\" alt=\"Lint\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/test-unit.yml\"\u003e\u003cimg src=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/test-unit.yml/badge.svg\" alt=\"Unit Tests\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/test-integration.yml\"\u003e\u003cimg src=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/test-integration.yml/badge.svg\" alt=\"Integration Tests\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/codeql.yml\"\u003e\u003cimg src=\"https://github.com/chirpz-ai/pandaprobe/actions/workflows/codeql.yml/badge.svg\" alt=\"CodeQL\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\n\u003cp align=\"center\"\u003e\n  \u003cvideo width=\"100%\" src=\"https://github.com/user-attachments/assets/074456d9-0af4-4757-8cf7-870746fa2eb6\" controls\u003e\u003c/video\u003e\n\u003c/p\u003e\n\n## What is PandaProbe?\nPandaProbe is an open source agent engineering platform. It helps teams collaboratively trace, evaluate, monitor, and debug AI agents. You can use PandaProbe cloud or self host the service.\n\n## Documentation\n\nVisit our client library documentation for quickstart and explore advance \u003ca href=\"https://docs.pandaprobe.com/tracing/integrations/overview\" target=\"_blank\"\u003eintegrations\u003c/a\u003e.\n\n\u003cp align=\"left\"\u003e\n  \u003ca href=\"https://docs.pandaprobe.com/get-started/quickstart\" target=\"_blank\"\u003e\n    \u003cimg alt=\"Documentation\" src=\"https://img.shields.io/badge/Docs%20Quickstart-0066FF\" /\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## PandaProbe Cloud\n\nManaged deployment by the PandaProbe team, generous free-tier, no credit card required.\n\n\u003cp align=\"left\"\u003e\n  \u003ca href=\"https://app.pandaprobe.com/\" target=\"_blank\"\u003e\n    \u003cimg alt=\"Sign up for PandaProbe Cloud\" src=\"https://img.shields.io/badge/%C2%BB%20Sign%20up%20for%20PandaProbe%20Cloud-0066FF\" /\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## Self-host PandaProbe\n\n\u003e **Prerequisites:** [Docker](https://docs.docker.com/get-docker/) must be installed and running.\n\n```bash\ngit clone https://github.com/chirpz-ai/pandaprobe.git\ncd pandaprobe\n./start.sh\n```\n\nOnce running, open:\n- **Dashboard** — http://localhost:3000\n- **API reference** — http://localhost:8000/scalar\n\n## Architecture\n\n```mermaid\nsequenceDiagram\n    participant Client as 📡 SDK / HTTP Client\n    participant API as ⚡ FastAPI\n    participant Auth as 🔐 Auth Service\n    participant IdP as 🌐 Supabase / Firebase\n    participant Identity as 👥 Identity Service\n    participant Trace as 🫆 Trace Service\n    participant Eval as 🧪 Eval Service\n    participant DB as 🗄️ PostgreSQL\n    participant Redis as 📮 Redis\n    participant Worker as ⚙️ Celery Worker\n    participant LLM as 🤖 LLM Engine (LiteLLM)\n\n    Note over Client,API: Management Plane (Bearer token)\n    Client-\u003e\u003eAPI: Authorization: Bearer \u003cidp_token\u003e\n    API-\u003e\u003eAuth: Verify token\n    Auth-\u003e\u003eIdP: Validate with provider\n    IdP--\u003e\u003eAuth: User identity\n    Auth--\u003e\u003eAPI: Authenticated user\n    API-\u003e\u003eIdentity: /user, /organizations, /projects\n    Identity-\u003e\u003eDB: Read / write\n    DB--\u003e\u003eIdentity: Result\n    Identity--\u003e\u003eClient: Response\n\n    Note over Client,API: Data Plane (API key)\n    Client-\u003e\u003eAPI: X-API-Key + X-Project-Name\n    API-\u003e\u003eIdentity: Resolve org \u0026 project\n    Identity--\u003e\u003eAPI: Project context\n\n    API-\u003e\u003eTrace: POST /traces\n    Trace-\u003e\u003eRedis: Enqueue ingestion job\n    Redis--\u003e\u003eClient: 202 Accepted\n    Redis-\u003e\u003eWorker: Pick up job\n    Worker-\u003e\u003eDB: Persist trace + spans\n\n    API-\u003e\u003eTrace: GET /traces, /sessions\n    Trace-\u003e\u003eDB: Query with filters\n    DB--\u003e\u003eTrace: Rows\n    Trace--\u003e\u003eClient: Paginated response\n\n    API-\u003e\u003eEval: POST /evaluations\n    Eval-\u003e\u003eRedis: Enqueue eval job\n    Redis--\u003e\u003eClient: 202 Accepted\n    Redis-\u003e\u003eWorker: Pick up job\n    Worker-\u003e\u003eLLM: LLM-as-a-judge call\n    LLM--\u003e\u003eWorker: Verdict + score\n    Worker-\u003e\u003eDB: Persist evaluation result\n```\n\n## Services\n\n| Service | Description | Port |\n|---|---|---|\n| **frontend** | Next.js dashboard | 3000 |\n| **app** | FastAPI application server | 8000 |\n| **worker** | Celery background worker | — |\n| **beat** | Celery Beat scheduler | — |\n| **postgres** | PostgreSQL 16 | 5432 |\n| **redis** | Redis 7 (broker + cache) | 6379 |\n\n## Contributing\n\nWe welcome contributions! Please read the [Contributing Guide](CONTRIBUTING.md) for instructions on setting up your development environment, building from source, running tests, and submitting pull requests.\n\n## Authors\n\nBuilt by the [Chirpz AI](https://pandaprobe.com/about) team. Contact sina@pandaprobe.com for enquiries.\n\n## License\n\nPandaProbe is licensed under Apache 2.0 — see [LICENSE](LICENSE) for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchirpz-ai%2Fpandaprobe","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchirpz-ai%2Fpandaprobe","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchirpz-ai%2Fpandaprobe/lists"}