{"id":13877813,"url":"https://github.com/opstower-ai/llm-opstower","last_synced_at":"2025-07-16T13:32:42.832Z","repository":{"id":189197723,"uuid":"680232430","full_name":"opstower-ai/llm-opstower","owner":"opstower-ai","description":"DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.","archived":false,"fork":false,"pushed_at":"2024-08-11T00:02:06.000Z","size":77,"stargazers_count":66,"open_issues_count":3,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-11-24T06:32:58.567Z","etag":null,"topics":["ai","aws","cli","devops"],"latest_commit_sha":null,"homepage":"https://www.opstower.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/opstower-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-08-18T17:06:09.000Z","updated_at":"2024-11-22T13:45:26.000Z","dependencies_parsed_at":"2024-08-11T01:22:35.943Z","dependency_job_id":"5868c4d7-1a93-4a53-b028-8991faae4ccb","html_url":"https://github.com/opstower-ai/llm-opstower","commit_stats":null,"previous_names":["opstower-ai/llm-opstower"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/opstower-ai/llm-opstower","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opstower-ai%2Fllm-opstower","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opstower-ai%2Fllm-opstower/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opstower-ai%2Fllm-opstower/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opstower-ai%2Fllm-opstower/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/opstower-ai","download_url":"https://codeload.github.com/opstower-ai/llm-opstower/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opstower-ai%2Fllm-opstower/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265514203,"owners_count":23780237,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","aws","cli","devops"],"created_at":"2024-08-06T08:01:25.421Z","updated_at":"2025-07-16T13:32:42.511Z","avatar_url":"https://github.com/opstower-ai.png","language":"Python","funding_links":[],"categories":["Python","Features"],"sub_categories":["Infrastructure productivity and maintainability"],"readme":"# 🗼 OpsTower.ai - DevOps AI Assistant\n\nSee beyond your dashboards, metrics, and logs. OpsTower.ai takes the grunt work out of DevOps, connecting to your systems (AWS, Docker, Kubernetes, etc) and debugging problems on its own.\n\n🚧 As of Oct '23, OpsTower.ai can answer questions about your AWS resources and perform calculations on cloudwatch metrics from the command line. [Learn about our larger vision](#user-content-vision).\n\n__🏆 OpsTower.ai is the current SOTA for accuracy in the [DevOps AI Assistant Open Leaderboard](https://github.com/opstower-ai/devops-ai-open-leaderboard) for AWS Services, AWS Cloudwatch Metrics, and AWS Billing.__\n\n_📅 [Book a time on my calendar](https://calendly.com/derek-haynes) or email derek@opstower.ai to chat about what capabalities you'd like to see._\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://www.loom.com/share/dcab0392e5104364a8dcc6a05491b906?sid=378db519-45c7-49df-b792-6d7af0d8854a\" target=\"_blank\"\u003e\u003cimg src=\"https://public-opstower.s3.amazonaws.com/demo_screenshot.png\"/\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n\u003ca href=\"#user-content-vision\"\u003e\u003cstrong\u003eVision\u003c/strong\u003e\u003c/a\u003e\n\u003cspan\u003e\u0026nbsp;\u0026nbsp;•\u0026nbsp;\u0026nbsp;\u003c/span\u003e\n\u003ca href=\"#user-content-install\"\u003e\u003cstrong\u003eInstall\u003c/strong\u003e\u003c/a\u003e\n\u003cspan\u003e\u0026nbsp;\u0026nbsp;•\u0026nbsp;\u0026nbsp;\u003c/span\u003e\n\u003ca href=\"#user-content-usage\"\u003e\u003cstrong\u003eUsage\u003c/strong\u003e\u003c/a\u003e\n\u003cspan\u003e\u0026nbsp;\u0026nbsp;•\u0026nbsp;\u0026nbsp;\u003c/span\u003e\n\u003ca href=\"#user-content-demo-mode\"\u003e\u003cstrong\u003eDemo Mode\u003c/strong\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n## Vision\n\nOpsTower.ai is AI Assistant that takes the grunt work out of DevOps. OpsTower.ai connects to your systems (AWS, Docker, Kubernetes, etc) and debugs and researches problems on its own.\n\nYou've probably played with some fragile demos in this space. That's not OpsTower.ai. At the heart of OpsTower.ai is a robust evaluation framework that allows us to measure the agent's performance against a large dataset of questions across problem domains. We're building a platform that will allow us to iterate on the agent's capabilities and measure its performance over time. We'll transparently share our results.\n\nSee our [Capabilities Roadmap](#user-content-capabilities-roadmap) below for more details on current evaluation results and planned knowledge areas.\n\n## Install\n\nInstalled as a plugin for [LLM](https://llm.datasette.io/), A CLI utility for interacting with LLMs.\n\nInstall `llm` if you haven't yet:\n\n```bash\npip install llm\n```\n\nInstall the OpsTower plugin:\n\n```bash\nllm install https://github.com/opstower-ai/llm-opstower/archive/refs/heads/main.zip\n```\n\nSet your API key. Use `demo` to try with a live AWS account or see [our docs](docs/aws_read_only_iam_user.md) for on creating a read-only IAM user.\n\n```bash\nllm keys set opstower --value demo\n```\n\nMake `opstower` your default model:\n\n```bash\nllm models default opstower\n```\n\n## Usage Examples\n\n__AWS Services__\n\n```bash\nllm \"list each ec2 instance id, name, state, last restart, image, and size\"\n```\n\n__AWS Cloudwatch Metrics__\n\n```bash\nllm \"What is the average CPU utilization of my EC2 instances?\"\n```\n__AWS Billing__\n\n```bash\nllm \"breakdown bill by aws service over the past 30 days\"\n```\n\n_The default timeframe is the past hour. You can specify a different timeframe in the question (ex: \"...over the past 10 minutes\")._\n\n## How it works\n\n![how it works](https://www.opstower.ai/assets/images/agent_eval/agent_orch.png)\n\nOpsTower.ai provides a OpenAI-compatible API. The `llm` CLI utility sends your credentials and question to our API. Server-side, OpsTower.ai generates AWS SDK code to answer your question and execute it in an isolated environment, summarizing the response.\n\nRead how the agent is structured and our current [evaluation results](https://www.opstower.ai/2023-evaluating-ai-agents/) against an AWS question dataset.\n\n## Authentication\n\nYou can query against your account by setting your API key in the following format:\n\n```bash\nllm keys set opstower --value AWS_ACCESS_KEY_ID:AWS_SECRET_ACCESS_KEY:AWS_REGION\n```\n\n## Demo Mode\n\nYou can execute commands against a demonstration AWS account that contains an EC2 instance, RDS instance, an Application Load Balancer, several Lambda functions, S3 buckets, and more.\n\nSet the opstower key to `demo`:\n\n```bash\nllm keys set opstower --value demo\n```\n\n## Capabilities Roadmap\n\nJust like how a Junior DevOps engineer isn't assigned with high-level tasks, OpsTower.ai's training is starting with a focus on information retrieval (ex: \"what is our estimated AWS bill for this month\"). After building up a base set of skills, OpsTower.ai will tackle reasoning you cannot infer from a ready-made dashboard (ex: \"what resources appear to be not used and/or over-provisioned and how much could we reduce costs?\").\n\n| Knowledge area | Status | Accuracy % |\n| -------- | -------- | -------- |\n| AWS services  | Released  | [92%](https://github.com/opstower-ai/devops-ai-open-leaderboard#-current-leaderboard)  |\n| AWS cloudwatch metrics | Released  | [89%](https://github.com/opstower-ai/devops-ai-open-leaderboard#-current-leaderboard)  |\n| AWS billing  | Released  | [91%](https://github.com/opstower-ai/devops-ai-open-leaderboard#-current-leaderboard)  |\n| AWS cloudwatch logs  |  🚧 | N/A |\n| AWS deployment  |   | N/A  |\n| AWS security  |   | N/A  |\n| Advanced AWS reasoning  |   | N/A  |\n| Docker  |   | N/A  |\n| Kubernetes  |   | N/A  |\n| Terraform  |   | N/A  |\n| Advanced Kubernetes reasoning  |   | N/A  |\n| Incident Investigation  |   | N/A  |\n\n## Limitations\n\n1. Only read-only operations are permitted. To be safe, you should only use an IAM user with read-only access.\n2. OpsTower.ai does not support higher-level and/or abstact questions like \"Has there been a sudden change in any critical ec2, rds, or s3 metrics?\". Try to be specific.\n3. Support for the `llm --continue` option is not yet available.\n\n## Uninstall\n\n```bash\nllm uninstall llm-opstower\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopstower-ai%2Fllm-opstower","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopstower-ai%2Fllm-opstower","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopstower-ai%2Fllm-opstower/lists"}