{"id":45747525,"url":"https://github.com/agentic-layer/ai-gateway-litellm-operator","last_synced_at":"2026-04-03T00:24:49.254Z","repository":{"id":316766420,"uuid":"1061921245","full_name":"agentic-layer/ai-gateway-litellm-operator","owner":"agentic-layer","description":"LiteLLM implementation of the Agentic Layer AI Gateway","archived":false,"fork":false,"pushed_at":"2026-02-25T14:57:57.000Z","size":225,"stargazers_count":1,"open_issues_count":3,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-02-25T19:33:34.736Z","etag":null,"topics":["agentic-ai","kubernetes","microservice","operator","operator-sdk"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/agentic-layer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-09-22T15:05:08.000Z","updated_at":"2026-02-25T14:51:09.000Z","dependencies_parsed_at":"2025-10-16T11:35:58.370Z","dependency_job_id":"e98e3bc2-8c6c-4c31-87c0-221e26f2df99","html_url":"https://github.com/agentic-layer/ai-gateway-litellm-operator","commit_stats":null,"previous_names":["agentic-layer/ai-gateway-litellm-operator"],"tags_count":15,"template":false,"template_full_name":null,"purl":"pkg:github/agentic-layer/ai-gateway-litellm-operator","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/agentic-layer%2Fai-gateway-litellm-operator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/agentic-layer%2Fai-gateway-litellm-operator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/agentic-layer%2Fai-gateway-litellm-operator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/agentic-layer%2Fai-gateway-litellm-operator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/agentic-layer","download_url":"https://codeload.github.com/agentic-layer/ai-gateway-litellm-operator/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/agentic-layer%2Fai-gateway-litellm-operator/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30121138,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-05T10:44:24.758Z","status":"ssl_error","status_checked_at":"2026-03-05T10:44:15.079Z","response_time":93,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agentic-ai","kubernetes","microservice","operator","operator-sdk"],"created_at":"2026-02-25T17:10:28.357Z","updated_at":"2026-04-03T00:24:49.243Z","avatar_url":"https://github.com/agentic-layer.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AI Gateway LiteLLM\n\n\"AI Gateway LiteLLM\" is a Kubernetes operator that creates and manages [LiteLLM](https://www.litellm.ai/) deployments.\n\nThe operator is based on the [Operator SDK](https://sdk.operatorframework.io/) framework. \n\n## Table of Contents\n\n- [Prerequisites](#prerequisites)\n- [Getting Started](#getting-started)\n- [Development](#development)\n- [Configuration](#configuration)\n- [End-to-End (E2E) Testing](#end-to-end-e2e-testing)\n- [Testing Tools and Configuration](#testing-tools-and-configuration)\n- [Sample Data](#sample-data)\n- [Contributing](#contribution)\n\n----\n## Prerequisites\n\nBefore working with this project, ensure you have the following tools installed on your system:\n\n* **Go**: version 1.26.0 or higher\n* **Docker**: version 20.10+ (or a compatible alternative like Podman)\n* **kubectl**: The Kubernetes command-line tool\n* **kind**: For running Kubernetes locally in Docker\n* **make**: The build automation tool\n\n----\n\n## Getting Started\n\n📖 **For detailed setup instructions**, see our [Getting Started guide](https://docs.agentic-layer.ai/ai-gateway-litellm/how-to-guides.html) in the documentation.\n\n**Quick Start:**\n\n\u003e **Note:** This operator requires the [AI Gateway Operator](https://github.com/agentic-layer/agent-runtime-operator) to be installed first, as it provides the required CRDs (`AiGateway` and `AiGatewayClass`).\n\n```shell\n# Create local cluster and install cert-manager\nkind create cluster\nkubectl apply -f https://github.com/cert-manager/cert-manager/releases/download/v1.19.1/cert-manager.yaml\n\n# Install the AI Gateway Operator (provides CRDs)\nkubectl apply -f https://github.com/agentic-layer/agent-runtime-operator/releases/download/v0.13.0/install.yaml\n\n# Install the LiteLLM operator\nkubectl apply -f https://github.com/agentic-layer/ai-gateway-litellm-operator/releases/download/v0.2.0/install.yaml\n```\n\n## Development\n\nFollow the prerequisites above to set up your local environment.\nThen follow these steps to build and deploy the operator locally:\n\n```shell\n# Install CRDs into the cluster\nmake install\n# Build docker image\nmake docker-build\n# Load image into kind cluster (not needed if using local registry)\nmake kind-load\n# Deploy the operator to the cluster\nmake deploy\n```\n\n## Configuration\n\n\n### Custom Resource Configuration\n\nTo deploy a LiteLLM AI Gateway instance, you define an `AiGateway` resource. Here is an example configuration:\n\n```yaml\napiVersion: runtime.agentic-layer.ai/v1alpha1\nkind: AiGateway\nmetadata:\n  name: my-litellm\nspec:\n  aiGatewayClassName: litellm\n  aiModels:\n    - provider: openai\n      name: gpt-3.5-turbo\n    - provider: gemini\n      name: gemini-1.5-pro\n  # see https://docs.litellm.ai/docs/proxy/config_settings#environment-variables---reference for a reference\n  env:\n   - name: DEBUG\n     value: \"true\"\n```\n\n\n## End-to-End (E2E) Testing\n\n### Prerequisites for E2E Tests\n\n- **kind** must be installed and available in PATH\n- **Docker** running and accessible\n- **kubectl** configured and working\n\n### Running E2E Tests\n\nThe E2E tests automatically create an isolated Kind cluster, deploy the operator, run comprehensive tests, and clean up afterwards.\n\n```bash\n# Run complete E2E test suite\nmake test-e2e\n```\n\nThe E2E test suite includes:\n- Operator deployment verification\n- CRD installation testing\n- Webhook functionality testing\n- Certificate management verification\n\n### Manual E2E Test Setup\n\nIf you need to run E2E tests manually or inspect the test environment:\n\n```bash\n# Set up test cluster (will create 'ai-gateway-litellm-test-e2e' cluster)\nmake setup-test-e2e\n```\n```bash\n# Run E2E tests against the existing cluster\nKIND_CLUSTER=ai-gateway-litellm-test-e2e go test ./test/e2e/ -v -ginkgo.v\n```\n```bash\n# Clean up test cluster when done\nmake cleanup-test-e2e\n```\n\n## Testing Tools and Configuration\n\n## Sample Data\n\nThe project includes sample `AiGateway` custom resources to help you get started.\n\n* **Where to find sample data?**\n  Sample manifests are located in the `config/samples/` directory.\n\n* **How to deploy a sample AI Gateway?**\n  You can deploy the sample \"my-litellm\" with the following `kubectl` command:\n\n  ```bash\n  kubectl apply -k config/samples/\n  ```\n\n* **How to verify the sample AI Gateway?**\n  After applying the sample, you can check the status of the created resources:\n\n  ```bash\n  # Check the aigateway's status\n  kubectl get aigateways my-litellm -o yaml\n  ```\n  ```bash\n  # Check the deployment created by the operator\n  kubectl get deployments -l app.kubernetes.io/name=my-litellm\n  ```\n\n## Contribution\n\nSee [Contribution Guide](https://github.com/agentic-layer/ai-gateway-litellm-operator?tab=contributing-ov-file) for details on contribution, and the process for submitting pull requests.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fagentic-layer%2Fai-gateway-litellm-operator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fagentic-layer%2Fai-gateway-litellm-operator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fagentic-layer%2Fai-gateway-litellm-operator/lists"}