{"id":41450126,"url":"https://github.com/stdapi-ai/stdapi.ai","last_synced_at":"2026-05-18T23:05:38.922Z","repository":{"id":323758371,"uuid":"1091653367","full_name":"stdapi-ai/stdapi.ai","owner":"stdapi-ai","description":"OpenAI \u0026 Anthropic Compatible API Gateway for AWS Bedrock and AI Services","archived":false,"fork":false,"pushed_at":"2026-03-28T23:05:56.000Z","size":10031,"stargazers_count":3,"open_issues_count":5,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-03-29T00:56:43.818Z","etag":null,"topics":["ai","anthropic","anthropic-api","anthropic-claude","bedrock","claude","claude-api","llm","openai-api","polly","transcribe"],"latest_commit_sha":null,"homepage":"https://stdapi.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/stdapi-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE-AGPL","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":"docs/roadmap.md","authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null},"funding":{"github":"jgoutin"}},"created_at":"2025-11-07T10:18:59.000Z","updated_at":"2026-03-28T23:05:33.000Z","dependencies_parsed_at":"2026-03-07T01:01:42.963Z","dependency_job_id":null,"html_url":"https://github.com/stdapi-ai/stdapi.ai","commit_stats":null,"previous_names":["stdapi-ai/stdapi.ai"],"tags_count":18,"template":false,"template_full_name":null,"purl":"pkg:github/stdapi-ai/stdapi.ai","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stdapi-ai%2Fstdapi.ai","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stdapi-ai%2Fstdapi.ai/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stdapi-ai%2Fstdapi.ai/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stdapi-ai%2Fstdapi.ai/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/stdapi-ai","download_url":"https://codeload.github.com/stdapi-ai/stdapi.ai/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stdapi-ai%2Fstdapi.ai/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31306053,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-02T09:48:21.550Z","status":"ssl_error","status_checked_at":"2026-04-02T09:48:19.196Z","response_time":89,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","anthropic","anthropic-api","anthropic-claude","bedrock","claude","claude-api","llm","openai-api","polly","transcribe"],"created_at":"2026-01-23T15:14:52.937Z","updated_at":"2026-05-18T23:05:38.916Z","avatar_url":"https://github.com/stdapi-ai.png","language":"Python","funding_links":["https://github.com/sponsors/jgoutin","https://github.com/sponsors/JGoutin"],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\u003cimg src=\"docs/styles/logo.svg\" alt=\"stdapi.ai logo\" width=\"40%\" /\u003e\n\n# stdapi.ai\n\n**OpenAI \u0026 Anthropic Compatible API Gateway for AWS Bedrock and AI Services**\n\nRun your favorite OpenAI and Anthropic-compatible applications on AWS Bedrock. Access 80+ models including Claude, Kimi K2, MiniMax, Qwen with enterprise privacy, compliance controls, and pay-per-use AWS pricing.\n\n---\n\n[![AWS Marketplace](https://img.shields.io/badge/AWS%20Marketplace-Enterprise%20Edition-FF9900?logo=data:image/svg%2bxml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIGZpbGw9IiNmZmZmZmYiIGZpbGwtcnVsZT0iZXZlbm9kZCIgc3R5bGU9ImZsZXg6bm9uZTtsaW5lLWhlaWdodDoxIiB2aWV3Qm94PSIwIDAgMjQgMjQiPjxwYXRoIGQ9Ik02Ljc2IDExLjIxcTAgLjQ1LjEuNzEuMDcuMjcuMjUuNTguMDYuMS4wNS4xOCAwIC4xMi0uMTUuMjRsLS41LjM0YS40LjQgMCAwIDEtLjIxLjA3cS0uMTIgMC0uMjQtLjExYTMgMyAwIDAgMS0uMjktLjM4bC0uMjQtLjQ3cS0uOTQgMS4xLTIuMzUgMS4xLTEgMC0xLjYtLjU3UTEgMTIuMzIgMSAxMS4zNnEwLTEuMDIuNzMtMS42NGEzIDMgMCAwIDEgMS45NS0uNjJxLjQyIDAgLjg1LjA2LjQ0LjA2LjkyLjE4di0uNTlxMC0uOS0uMzgtMS4yNy0uMzctLjM3LTEuMy0uMzctLjQyIDAtLjg2LjFhNiA2IDAgMCAwLTEuMTQuMzhsLS4xMy4wMnEtLjE3IDAtLjE3LS4yNHYtLjRxMC0uMTguMDYtLjI4YTEgMSAwIDAgMSAuMjItLjE2IDUgNSAwIDAgMSAxLS4zNkE1IDUgMCAwIDEgNCA2LjAycTEuNDMgMCAyLjEuNjQuNjYuNjUuNjYgMS45N3YyLjU4em0tMy4yNCAxLjIycS40IDAgLjgyLS4xNWEyIDIgMCAwIDAgLjc2LS41IDEgMSAwIDAgMCAuMjgtLjUycS4wNy0uMjkuMDgtLjd2LS4zM2E3IDcgMCAwIDAtLjc0LS4xNCA2IDYgMCAwIDAtLjc1LS4wNHEtLjggMC0xLjE5LjMyLS4zOS4zMS0uMzkuOTEgMCAuNTcuMy44NS4yOC4zLjgzLjNtNi40MS44NnEtLjIxIDAtLjMtLjA4LS4xLS4wOC0uMTctLjMxTDcuNiA2LjczIDcuNSA2LjRxMC0uMi4yLS4yaC43OHEuMjMgMCAuMy4wOC4xLjA4LjE3LjNsMS4zNCA1LjMgMS4yNS01LjNxLjA1LS4yMy4xNS0uM2EuNi42IDAgMCAxIC4zMi0uMDhoLjYzcS4yMyAwIC4zMi4wOC4xLjA4LjE2LjNsMS4yNiA1LjM2IDEuMzgtNS4zNXEuMDctLjI1LjE2LS4zMWEuNS41IDAgMCAxIC4zLS4wOGguNzVxLjIgMCAuMi4yIDAgLjA2LS4wMi4xMmwtLjA1LjItMS45MiA2LjE3cS0uMDcuMjUtLjE3LjMxYS41LjUgMCAwIDEtLjMuMDhoLS43cS0uMjEgMC0uMzEtLjA3LS4xLS4wOS0uMTUtLjMzbC0xLjI0LTUuMTQtMS4yMyA1LjE0cS0uMDYuMjQtLjE1LjMyLS4xLjA4LS4zMi4wOHptMTAuMjYuMjFhNSA1IDAgMCAxLTIuMTUtLjQ2cS0uMi0uMTEtLjI0LS4yMmExIDEgMCAwIDEtLjA1LS4yM3YtLjRxMC0uMjUuMTgtLjI1LjA4IDAgLjE0LjAybC4yLjA4YTQgNCAwIDAgMCAxLjgzLjM4cS43NiAwIDEuMTctLjI3YS45LjkgMCAwIDAgLjQxLS43NS44LjggMCAwIDAtLjIxLS41NiAyIDIgMCAwIDAtLjgxLS40MmwtMS4xNi0uMzZhMi40IDIuNCAwIDAgMS0xLjI3LS44MSAyIDIgMCAwIDEtLjQtMS4xNnEwLS41LjIxLS44OS4yMi0uMzguNTgtLjY1LjM1LS4yNy44My0uNDFhMy41IDMuNSAwIDAgMSAxLjU0LS4xbC41Mi4wOC40NS4xM3EuMjEuMDcuMzQuMTRhMSAxIDAgMCAxIC4yNC4yLjQuNCAwIDAgMSAuMDcuMjZ2LjM4cTAgLjI1LS4xOS4yNWExIDEgMCAwIDEtLjMtLjEgNCA0IDAgMCAwLTEuNTMtLjNxLS43IDAtMS4wNi4yMi0uMzguMjItLjM4LjcxIDAgLjM0LjI0LjU3LjI1LjIzLjg4LjQ0bDEuMTMuMzZxLjg4LjI4IDEuMjQuNzYuMzcuNS4zNyAxLjEyIDAgLjUxLS4yMS45M2EyIDIgMCAwIDEtLjU4LjdxLS4zOC4zLS44OS40NS0uNTMuMTYtMS4xNC4xNk0uMzggMTUuNDhhMjQgMjQgMCAwIDAgMTEuODggMy4xNWMyLjkgMCA2LjEtLjYgOS4wNi0xLjg1LjQ0LS4yLjguMjguMzguNi0yLjYzIDEuOTQtNi40NCAyLjk3LTkuNzIgMi45Ny00LjYgMC04Ljc0LTEuNy0xMS44Ny00LjUyLS4yNS0uMjMtLjAzLS41My4yNy0uMzVtMjMuNTMtLjJjLjI5LjM2LS4wOCAyLjgyLTEuNDkgNC0uMjEuMTktLjQyLjA5LS4zMi0uMTVsLjE3LS40NGMuMzQtLjg4LjgtMi4yLjUyLTIuNTUtLjMzLS40My0yLjIyLS4yMS0zLjA3LS4xLS4yNi4wMy0uMy0uMi0uMDctLjM3IDEuNS0xLjA1IDMuOTctLjc1IDQuMjYtLjQiLz48L3N2Zz4=)](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo)\n[![Terraform Module](https://img.shields.io/badge/Terraform-Enterprise%20Edition%20module-844FBA?logo=terraform\u0026logoColor=ffffff)](https://registry.terraform.io/modules/stdapi-ai/stdapi-ai/aws/latest)\n[![OpenTofu Module](https://img.shields.io/badge/OpenTofu-Enterprise%20Edition%20module-FFDA18?logo=opentofu\u0026logoColor=ffffff)](https://search.opentofu.org/module/stdapi-ai/stdapi-ai/aws/latest)\n\n[**14-day free trial on AWS Marketplace** · **$0.10/container-hour**](https://stdapi.ai/operations_getting_started/)\n\n---\n[![Community Edition Docker image](https://img.shields.io/badge/Docker-Community%20Edition-2496ED?logo=docker\u0026logoColor=ffffff)](https://github.com/stdapi-ai/stdapi.ai/pkgs/container/stdapi.ai-community)\n[![Community Edition TrueNAS App](https://img.shields.io/badge/TrueNAS-Community%20Edition-0095D5?logo=truenas\u0026logoColor=ffffff)](https://apps.truenas.com/catalog/stdapi-ai/)\n[![Community Edition License](https://img.shields.io/badge/Community%20Edition%20License-AGPL%203.0-BD0000.svg?logo=gplv3\u0026logoColor=ffffff)](LICENSE-AGPL)\n\n[**Free for local development** · **Try Locally with Docker**](#-try-it-locally-with-docker)\n\n---\n[![Documentation](https://img.shields.io/badge/Documentation-stdapi.ai-526CFE?logo=materialformkdocs\u0026logoColor=ffffff)](https://stdapi.ai)\n[![Samples](https://img.shields.io/badge/Examples-stdapi.ai--samples-24292E?logo=github\u0026logoColor=ffffff)](https://github.com/stdapi-ai/samples)\n[![Lint](https://github.com/stdapi-ai/stdapi.ai/actions/workflows/lint.yml/badge.svg)](https://github.com/stdapi-ai/stdapi.ai/actions/workflows/lint.yml)\n[![Code quality](https://app.codacy.com/project/badge/Grade/a6036988660e47e7bf59821f55105464)](https://app.codacy.com/gh/stdapi-ai/stdapi.ai/dashboard?utm_source=gh\u0026utm_medium=referral\u0026utm_content=\u0026utm_campaign=Badge_grade)\n\n\u003c/div\u003e\n\n---\n\n## ⚡ Try It Locally with Docker\n\nRun stdapi.ai locally with the free community image. Requires [AWS credentials](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html) configured (run `aws sso login` first).\n\n```bash\ndocker run --rm -p 8000:8000 \\\n  -v ~/.aws:/home/nonroot/.aws:ro \\\n  -e AWS_BEDROCK_REGIONS=us-east-1,us-west-2 \\\n  -e ENABLE_DOCS=true \\\n  ghcr.io/stdapi-ai/stdapi.ai-community:latest\n```\n\n\u003e **Podman on Fedora/RHEL (SELinux):** Add `--userns=keep-id` and use `:ro,z` instead of `:ro`\n\nOpen **[http://localhost:8000/docs](http://localhost:8000/docs)** in your browser — Swagger UI lets you explore all endpoints and send live requests without writing any code.\n\nOr test from the terminal with `curl`:\n\n**List available models:**\n\n```bash\n# All discovered models with capabilities, modalities, and supported routes\ncurl http://localhost:8000/search_models\n\n# Filter — e.g. vision-capable chat models only\ncurl \"http://localhost:8000/search_models?route=/v1/chat/completions\u0026input_modalities=IMAGE\"\n\n# OpenAI-compatible model list\ncurl http://localhost:8000/v1/models\n```\n\n**OpenAI-compatible chat:**\n\n```bash\ncurl http://localhost:8000/v1/chat/completions \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\n    \"model\": \"amazon.nova-micro-v1:0\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Hello from AWS Bedrock!\"}]\n  }'\n```\n\n**Anthropic-compatible chat:**\n\n```bash\ncurl http://localhost:8000/anthropic/v1/messages \\\n  -H \"anthropic-version: 2023-06-01\" \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\n    \"model\": \"amazon.nova-micro-v1:0\",\n    \"max_tokens\": 1000,\n    \"messages\": [{\"role\": \"user\", \"content\": \"Hello from AWS Bedrock!\"}]\n  }'\n```\n\n**Using the official SDKs?** Point `base_url` at `http://localhost:8000/v1` (OpenAI SDK) or `http://localhost:8000/anthropic` (Anthropic SDK) — no other code changes.\n\n**[Local development guide →](https://stdapi.ai/operations_getting_started_local/)**\n\n---\n\n## 🚀 Production Deployment\n\nDeploy to AWS in minutes with Terraform. The [AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo) subscription includes a **14-day free trial**.\n\n```hcl\nmodule \"stdapi_ai\" {\n  source  = \"stdapi-ai/stdapi-ai/aws\"\n  version = \"~\u003e 1.0\"\n}\n```\n\nThat's it. You get a production-grade ECS Fargate deployment with HTTPS, WAF, auto-scaling, and monitoring.\n\n**[Full deployment guide →](https://stdapi.ai/operations_getting_started/)** · **[Advanced deployment →](https://stdapi.ai/operations_deploy_advanced/)**\n\nPrefer a hands-off setup? A [managed deployment service](https://aws.amazon.com/marketplace/pp/prodview-xknxzjgl7zi5s) is available.\n\n---\n\n## 🎯 Why stdapi.ai?\n\n- **🔌 Drop-in replacement** — Change only the base URL. Works with LangChain, Continue.dev, Open WebUI, n8n, Claude Code, Aider, and 1000+ tools.\n- **🔒 Data stays in your AWS account** — All inference runs in your account. Data never shared with model providers or used for training. Configure allowed regions for GDPR, HIPAA, FedRAMP.\n- **🌍 Multiply quota across regions** — Each AWS region has independent quota. 3 regions = 3× tokens per minute. Automatic routing and failover—no client changes.\n- **💰 Pay only what you use** — AWS Bedrock rates, no markup, no subscriptions or monthly minimums.\n- **⚡ Advanced Bedrock features** — Reasoning modes (Claude, Nova), prompt caching, guardrails, service tiers, inference profiles, prompt routers—all through standard OpenAI and Anthropic API parameters.\n- **🧠 80+ models** — Claude, Kimi K2, MiniMax, Qwen, GLM, Nova, Llama, Stability AI, and more. Switch instantly—no vendor lock-in.\n- **🎨 Complete multi-modal API** — Chat, embeddings, image generation/editing/variations, audio speech/transcription/translation. Amazon Polly, Transcribe, Translate unified under OpenAI-compatible endpoints.\n- **📊 Full observability** — OpenTelemetry integration, request/response logging, Swagger and ReDoc API documentation.\n- **🤖 Integrated MCP server** — Every API endpoint exposed as a Model Context Protocol tool. AI agents connect directly—no HTTP client code required. Streamable HTTP and SSE transports with configurable tool selection.\n- **🔄 Automatic deprecated model fallback** — When AWS retires a model, requests are transparently redirected to its replacement. Applications survive model deprecations without code changes.\n\n**[See all features →](https://stdapi.ai/features/)**\n\n---\n\n## 💼 Use Cases\n\n| Category | What You Can Build | Tools | Guide |\n|---|---|---|---|\n| **💬 Chat Interfaces** | Private ChatGPT alternative, team chat, knowledge base with RAG | Open WebUI, LibreChat | [Guide →](https://stdapi.ai/use_cases_openwebui/) |\n| **💻 Coding Assistants** | AI pair programming, code completion, codebase chat | Continue.dev, Cline, Cursor, Claude Code, Aider | [Guide →](https://stdapi.ai/use_cases_coding_assistants/) |\n| **🔄 Workflow Automation** | AI-powered ticket routing, content creation, data processing | n8n, Make, Zapier | [Guide →](https://stdapi.ai/use_cases_n8n/) |\n| **🤖 Chatbots** | Slack/Discord/Teams bots, documentation assistants | Slack Bot, Botpress | |\n| **🧠 Autonomous Agents** | Personal AI assistants, research agents, multi-agent systems, code agents | OpenClaw, LangGraph, CrewAI, AutoGPT | |\n\n**[All use cases and integration guides →](https://stdapi.ai/use_cases/)**\n\n---\n\n## 🛒 AWS Marketplace — Commercial Edition\n\nThe commercial license via [AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo) is for production, internal tools, and proprietary applications:\n\n- ✅ **14-day free trial** — test in your environment risk-free\n- ✅ **Commercial license** — no AGPL obligations, keep your code private\n- ✅ **Hardened containers** — security-optimized with regular updates\n- ✅ **Terraform module** — production-ready infrastructure in minutes\n- ✅ **Streamlined AWS billing** — consolidated with your existing AWS costs\n\n**[Start 14-Day Free Trial →](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo)**\n\n---\n\n## 🛠️ Development from Source\n\nFor contributors working on stdapi.ai itself:\n\n### Prerequisites\n\n- Python 3.14+\n- [uv](https://github.com/astral-sh/uv) package manager\n- AWS credentials configured\n\n### Setup\n\n```bash\ngit clone https://github.com/stdapi-ai/stdapi.ai.git\ncd stdapi.ai\nuv sync --frozen --extra uvicorn\n\naws sso login --profile your-profile-name\n\nexport AWS_BEDROCK_REGIONS=us-east-1\nexport ENABLE_DOCS=true\n\nuv run uvicorn stdapi.main:app --host 0.0.0.0 --port 8000\n```\n\n### Development Guidelines\n\n- Follow existing code style and conventions\n- Add tests for new features\n- Update documentation for user-facing changes\n- Ensure all tests pass before submitting PR\n\n---\n\n## 📜 License\n\nDual-licensed:\n\n- **[AGPL-3.0-or-later](LICENSE-AGPL)** — Free for open-source projects that share alike\n- **[Commercial License](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo)** — AWS Marketplace, for proprietary applications (14-day free trial)\n\n**[Learn more about licensing →](https://stdapi.ai/operations_licensing/)**\n\n---\n\n## 🤝 Contributing\n\nWe welcome contributions! Whether it's bug reports, new features, documentation improvements, or ideas — please feel free to open issues or submit pull requests.\n\n---\n\n## 💬 Support\n\n- **Issues:** [GitHub Issue Tracker](https://github.com/stdapi-ai/stdapi.ai/issues)\n- **Documentation:** [stdapi.ai](https://stdapi.ai)\n- **Sponsor:** [GitHub Sponsors](https://github.com/sponsors/JGoutin) — Priority support, feature prioritization, and influence on the roadmap. [View tiers →](https://github.com/sponsors/JGoutin)\n\n---\n\n\u003cdiv align=\"center\"\u003e\n\n**Ready to run 80+ AI models securely on AWS?**\n\n[Start 14-Day Free Trial on AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-su2dajk5zawpo) · [Deployment guide](https://stdapi.ai/operations_getting_started/) · [Terraform examples](https://github.com/stdapi-ai/samples) · [Try Locally with Docker](#-try-it-locally-with-docker)\n\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstdapi-ai%2Fstdapi.ai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstdapi-ai%2Fstdapi.ai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstdapi-ai%2Fstdapi.ai/lists"}