{"id":46320351,"url":"https://github.com/arthur-ai/arthur-engine","last_synced_at":"2026-06-17T18:01:28.058Z","repository":{"id":284676302,"uuid":"955570780","full_name":"arthur-ai/arthur-engine","owner":"arthur-ai","description":"Make AI work for Everyone - Monitoring and governing for your AI/ML ","archived":false,"fork":false,"pushed_at":"2026-06-15T12:14:48.000Z","size":54538,"stargazers_count":82,"open_issues_count":44,"forks_count":13,"subscribers_count":4,"default_branch":"dev","last_synced_at":"2026-06-15T12:20:19.527Z","etag":null,"topics":["agentic","benchmarking","evaluation","genai","guardrails","llm","ml","monitoring","tracing"],"latest_commit_sha":null,"homepage":"https://arthur.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arthur-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-03-26T21:08:54.000Z","updated_at":"2026-06-15T12:05:41.000Z","dependencies_parsed_at":"2026-03-04T16:01:16.446Z","dependency_job_id":"8e0cf3b4-8d37-4cba-b627-17030d36d287","html_url":"https://github.com/arthur-ai/arthur-engine","commit_stats":null,"previous_names":["arthur-ai/arthur-engine"],"tags_count":640,"template":false,"template_full_name":null,"purl":"pkg:github/arthur-ai/arthur-engine","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur-ai%2Farthur-engine","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur-ai%2Farthur-engine/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur-ai%2Farthur-engine/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur-ai%2Farthur-engine/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arthur-ai","download_url":"https://codeload.github.com/arthur-ai/arthur-engine/tar.gz/refs/heads/dev","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur-ai%2Farthur-engine/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34459619,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-17T02:00:05.408Z","response_time":127,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agentic","benchmarking","evaluation","genai","guardrails","llm","ml","monitoring","tracing"],"created_at":"2026-03-04T15:01:30.008Z","updated_at":"2026-06-17T18:01:28.045Z","avatar_url":"https://github.com/arthur-ai.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"https://cdn.prod.website-files.com/5a749d2c4f343700013366d4/67eab9e594ec4accb58badeb_arthur-logo-symbol.svg\" alt=\"Arthur AI Logo\" width=\"150\"/\u003e\n\n\u003ci\u003eMake AI work for Everyone.\u003c/i\u003e\n\n[![GenAI Engine CI](https://github.com/arthur-ai/arthur-engine/actions/workflows/arthur-engine-workflow.yml/badge.svg)](actions?query=workflow%3A%22%22GenAI+Engine+Workflow%22%22++)\n[![Discord](https://img.shields.io/badge/Discord-Arthur-blue?logo=discord\u0026logoColor=white)](https://discord.gg/tdfUAtaVHz)\n\n[Website](https://arthur.ai?utm_source=github\u0026utm_medium=readme) - [Documentation](https://docs.arthur.ai/?utm_source=github\u0026utm_medium=readme) - [Talk to someone at Arthur](https://www.arthur.ai/book-demo?utm_source=github\u0026utm_medium=readme)\n\n\u003c/div\u003e\n\n# The Arthur Engine\n\nThe Arthur Engine provides a **complete service** for developing, monitoring, and governing your AI/ML workloads using popular open-source technologies and frameworks. It is a tool designed for:\n\n- **Enforcing Guardrails in your LLM Applications and Generative AI Workflows**\n  - Configurable metrics for real-time detection of PII or Sensitive Data leakage, Hallucination, Prompt Injection attempts, Toxic language, and other quality metrics\n- **Building, Evaluating, Observing and Governing Agentic Applications**\n  - Collect and analyze OpenInference OpenTelemetry (OTEL) traces from any agentic workflow or LLM application\n  - Run continuous evaluations on live traces to catch regressions and quality issues automatically\n  - Manage, version, and iterate on prompts across your applications\n  - Run experiments to compare prompt variants and measure their impact on quality metrics\n  - Evaluate and monitor Retrieval-Augmented Generation (RAG) pipelines end-to-end\n- **Monitoring and Benchmarking Machine Learning models (requires the Arthur Platform)**\n  - Support for a wide range of evaluation metrics (e.g., drift, accuracy, precision, recall, F1, and AUC)\n  - Tools for comparing models, exploring feature importance, and identifying areas for optimization\n  - For LLMs/GenAI applications, measure and monitor response relevance, hallucination rates, token counts, latency, and more\n- **Extensibility to fit into your application's architecture**\n  - Native support for custom metrics and extensible API\n\n## Quickstart\n\n**Claude Code users**\n\nPaste this prompt directly into Claude Code that's running on your agent application:\n\n```\nFor each skill name in this list — arthur-onboard-oss, arthur-onboard-oss-engine, arthur-onboard-task, arthur-onboard-analyze, arthur-onboard-instrument, arthur-onboard-prompts, arthur-onboard-verify, arthur-onboard-eval-provider, arthur-onboard-evals, arthur-skills-upgrade — fetch https://raw.githubusercontent.com/arthur-ai/arthur-engine/refs/heads/main/integrations/claude-code-skills/arthur-onboard/\u003cskill-name\u003e/SKILL.md and save it to ~/.claude/skills/\u003cskill-name\u003e/SKILL.md (create the directory if it doesn't exist). Also fetch https://raw.githubusercontent.com/arthur-ai/arthur-engine/refs/heads/main/integrations/claude-code-skills/arthur-onboard/arthur-onboard-instrument/EXAMPLES.md and save it to ~/.claude/skills/arthur-onboard-instrument/EXAMPLES.md. Once all files are saved, read ~/.claude/skills/arthur-onboard-oss/SKILL.md and follow its instructions.\n```\n\n**Codex users**\n\nPaste this prompt directly into a Codex session that's running on your agent application:\n\n```\nInstall the Arthur OSS onboarding Codex skills from arthur-ai/arthur-engine.\n\nInstall these skill folders into ${CODEX_HOME:-~/.codex}/skills:\n- arthur-onboard-oss\n- arthur-onboard-oss-engine\n- arthur-onboard-task\n- arthur-onboard-analyze\n- arthur-onboard-instrument\n- arthur-onboard-prompts\n- arthur-onboard-verify\n- arthur-onboard-eval-provider\n- arthur-onboard-evals\n\nFetch each SKILL.md from:\nhttps://raw.githubusercontent.com/arthur-ai/arthur-engine/main/integrations/claude-code-skills/arthur-onboard/\u003cskill-name\u003e/SKILL.md\n\nCreate each directory as needed. After installation, remind me to restart Codex.\n```\n\n**Everyone else**\n\n1. Run the engine installer with the below command:\n\nMac\n```\nbash \u003c(curl -sSL https://get-genai-engine.arthur.ai/mac)\n```\n\nWindows\n```\niex (iwr -Uri \"https://get-genai-engine.arthur.ai/win\" -UseBasicParsing).Content\n```\n\n2. Instrument your agents for evaluations and LLM guardrailing by referencing the examples:\n\nhttps://github.com/arthur-ai/arthur-engine/tree/dev/genai-engine/examples\n\n![Arthur Engine](./docs/images/arthur-engine.png)\n\n## Arthur Platform Free Version\n\nTo unlock the full capabilities of the Arthur Platform, [sign up](https://platform.arthur.ai/signup) and get started for free.\n* Custom dashboards\n* Alerts and notifications\n* Configurable webhook that can trigger any workflow\n* Agent discovery\n* Governance\n\n**Claude Code users**\n\nPaste this prompt directly into a Claude Code session that's running on your agent application:\n\n```\nFor each skill name in this list — arthur-onboard-platform, arthur-onboard-platform-access, arthur-onboard-platform-workspace, arthur-onboard-platform-engine, arthur-onboard-platform-model, arthur-onboard-platform-token, arthur-onboard-analyze, arthur-onboard-instrument, arthur-onboard-prompts, arthur-onboard-verify, arthur-onboard-eval-provider, arthur-onboard-evals — fetch https://raw.githubusercontent.com/arthur-ai/arthur-engine/refs/heads/main/integrations/claude-code-skills/arthur-onboard/\u003cskill-name\u003e/SKILL.md and save it to ~/.claude/skills/\u003cskill-name\u003e/SKILL.md (create the directory if it doesn't exist). Once all skills are saved, read ~/.claude/skills/arthur-onboard-platform/SKILL.md and follow its instructions.\n```\n\n**Codex users**\n\nInstall the Arthur Platform onboarding Codex skills from arthur-ai/arthur-engine.\n\n```\nInstall these skill folders into ${CODEX_HOME:-~/.codex}/skills:\n- arthur-onboard-platform\n- arthur-onboard-platform-access\n- arthur-onboard-platform-workspace\n- arthur-onboard-platform-engine\n- arthur-onboard-platform-model\n- arthur-onboard-platform-token\n- arthur-onboard-analyze\n- arthur-onboard-instrument\n- arthur-onboard-prompts\n- arthur-onboard-verify\n- arthur-onboard-eval-provider\n- arthur-onboard-evals\n\nFetch each SKILL.md from:\nhttps://raw.githubusercontent.com/arthur-ai/arthur-engine/main/integrations/claude-code-skills/arthur-onboard/\u003cskill-name\u003e/SKILL.md\n\nCreate each directory as needed. After installation, remind me to restart Codex.\n```\n\n**Everyone else**\n\nOnboard via the platform UI.\n\n![Arthur Platform](./docs/images/arthur-platform.png)\n\n## Arthur Platform Enterprise Version\n\n**The enterprise version of the Arthur Platform provides better performance, additional features, and capabilities**, including custom enterprise-ready guardrails + metrics, which can maximize the potential of AI for your organization.\n\nKey features:\n\n- State-of-the-art proprietary evaluation models trained by Arthur's world-class machine learning engineering team\n- Air-gapped deployment of the Arthur Engine (no dependency to Hugging Face Hub)\n- Optional on-premises deployment of the entire Arthur Platform\n- Support from the world-class engineering teams at Arthur\n\nTo learn more about the enterprise version of the Arthur Platform, [reach out!](https://www.arthur.ai/book-demo)\n\n## Contributing\n\n- Join the Arthur community on [Discord](https://discord.gg/tdfUAtaVHz) to get help and share your feedback.\n- To make a request for a bug fix or a new feature, please file a [GitHub issue](https://github.com/arthur-ai/arthur-engine/issues).\n- To make code contributions, please review the [contributing guidelines](CONTRIBUTING.md).\n- Thank you!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthur-ai%2Farthur-engine","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farthur-ai%2Farthur-engine","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthur-ai%2Farthur-engine/lists"}