{"id":24041820,"url":"https://github.com/videmsky/aws-ts-ollama","last_synced_at":"2026-04-30T11:36:12.194Z","repository":{"id":232256777,"uuid":"783457387","full_name":"videmsky/aws-ts-ollama","owner":"videmsky","description":"a pulumi project that creates ollama resources in AWS","archived":false,"fork":false,"pushed_at":"2024-04-19T14:32:06.000Z","size":54,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-26T08:17:41.149Z","etag":null,"topics":["aws","ollama","pulumi","typescript"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/videmsky.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-04-07T23:25:54.000Z","updated_at":"2024-07-23T07:39:39.000Z","dependencies_parsed_at":"2024-04-08T22:06:25.679Z","dependency_job_id":"b190439b-b6b2-4fc9-9a25-e98511fa77f1","html_url":"https://github.com/videmsky/aws-ts-ollama","commit_stats":null,"previous_names":["videmsky/aws-ts-ollama"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/videmsky/aws-ts-ollama","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/videmsky%2Faws-ts-ollama","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/videmsky%2Faws-ts-ollama/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/videmsky%2Faws-ts-ollama/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/videmsky%2Faws-ts-ollama/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/videmsky","download_url":"https://codeload.github.com/videmsky/aws-ts-ollama/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/videmsky%2Faws-ts-ollama/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32463892,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-29T22:27:22.272Z","status":"online","status_checked_at":"2026-04-30T02:00:05.929Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","ollama","pulumi","typescript"],"created_at":"2025-01-08T22:12:39.966Z","updated_at":"2026-04-30T11:36:12.151Z","avatar_url":"https://github.com/videmsky.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"This repository uses Pulumi to create a Ollama server on a AWS GPU backed EC2 instance and an Open-WebUI client on ECS. Trialing models locally can be extremely slow and therefefore this repo aims to provide a simple way to run models with AWS GPU resources. Use with caution as GPU instances can get expensive!\n\n[Ollama](https://github.com/ollama/ollama)\n[Open WebUI](https://github.com/open-webui/open-webui)\n\n### Prerequisites\n- AWS account and credentials configured with Pulumi ESC\n- Pulumi CLI installed\n- SSH keys added to Pulumi ESC\n\n### ESC Environment Definition Sample\n\n```yaml\nvalues:\n  aws:\n    creds:\n      fn::open::aws-login:\n        oidc:\n          duration: 1h\n          roleArn: arn:aws:iam::12345678910:role/laci-pulumi-corp\n          sessionName: pulumi-environments-session\n  environmentVariables:\n    AWS_ACCESS_KEY_ID: ${aws.creds.accessKeyId}\n    AWS_SECRET_ACCESS_KEY: ${aws.creds.secretAccessKey}\n    AWS_SESSION_TOKEN: ${aws.creds.sessionToken}\n  pulumiConfig:\n    publicKey: ssh-ed25519 AAAAC...\n    privateKey:\n      fn::secret:\n        ciphertext: ZXNjeAAAAA...\n```\n\n### Deploying and Running the Program\n\n1. Create a new stack:\n`$ pulumi stack init dev`\n\n2. Set local configuration variables:\n* `$ pulumi config set aws-ts-ollama:instanceType \"g4dn.xlarge\"`\n* `$ pulumi config set aws-ts-ollama:vpcNetworkCidr \"10.9.0.0/16\"`\n* `$ pulumi config set aws-ts-ollama:containerPort \"8080\"`\n* `$ pulumi config set aws-ts-ollama:cpu \"256\"`\n* `$ pulumi config set aws-ts-ollama:memory \"512\"`\n\n3. `Pulumi.dev.yaml` should look like this:\n```yaml\nenvironment:\n  - laci-dev\nconfig:\n  aws-ts-ollama:instanceType: g4dn.xlarge\n  aws-ts-ollama:vpcNetworkCidr: \"10.9.0.0/16\"\n  aws-ts-ollama:containerPort: \"8080\"\n  aws-ts-ollama:cpu: \"256\"\n  aws-ts-ollama:memory: \"512\"\n```\n\n### Clean Up\n\n1. To clean up resources, run:\n`$ pulumi pulumi destroy -s dev`","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvidemsky%2Faws-ts-ollama","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvidemsky%2Faws-ts-ollama","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvidemsky%2Faws-ts-ollama/lists"}