{"id":14964718,"url":"https://github.com/fly-apps/ollama-open-webui","last_synced_at":"2025-10-28T15:30:43.967Z","repository":{"id":221141126,"uuid":"753560275","full_name":"fly-apps/ollama-open-webui","owner":"fly-apps","description":"Self-host a ChatGPT-style web interface for Ollama 🦙","archived":false,"fork":false,"pushed_at":"2024-08-14T09:30:26.000Z","size":29,"stargazers_count":73,"open_issues_count":3,"forks_count":26,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-02-06T07:08:52.057Z","etag":null,"topics":["ai","gemma","gpu","llama3","llava","mistral","mixtral","ollama","ollama-webui"],"latest_commit_sha":null,"homepage":"https://fly.io/docs/gpus/","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fly-apps.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-06T11:13:30.000Z","updated_at":"2025-02-03T10:24:12.000Z","dependencies_parsed_at":"2024-05-07T16:29:13.504Z","dependency_job_id":"5b791db3-a73e-45c2-bd07-7abe73a05302","html_url":"https://github.com/fly-apps/ollama-open-webui","commit_stats":{"total_commits":21,"total_committers":3,"mean_commits":7.0,"dds":0.09523809523809523,"last_synced_commit":"701024d497ba62853b296550e022df5f1d229e52"},"previous_names":["fly-apps/ollama-webui-demo"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Follama-open-webui","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Follama-open-webui/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Follama-open-webui/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Follama-open-webui/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fly-apps","download_url":"https://codeload.github.com/fly-apps/ollama-open-webui/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238668053,"owners_count":19510495,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","gemma","gpu","llama3","llava","mistral","mixtral","ollama","ollama-webui"],"created_at":"2024-09-24T13:33:41.172Z","updated_at":"2025-10-28T15:30:38.668Z","avatar_url":"https://github.com/fly-apps.png","language":"Shell","funding_links":[],"categories":["Shell"],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n  \u003cpicture\u003e\n    \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"https://github.com/fly-apps/ollama-open-webui/assets/3727384/25c0bc76-cf50-431d-8435-707fac9c2b1a\"\u003e\n    \u003cimg height=\"100px\" src=\"https://github.com/fly-apps/ollama-open-webui/assets/3727384/5659f0e4-c4c7-4a0a-9949-d8042564be45\"\u003c/img\u003e\n  \u003c/picture\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003cp\u003eRun \u003cstrong\u003e\u003ca href=\"https://github.com/ollama/ollama\"\u003eOllama\u003c/a\u003e\u003c/strong\u003e and \u003cstrong\u003e\u003ca href=\"https://github.com/open-webui/open-webui\"\u003eOpen WebUI\u003c/a\u003e\u003c/strong\u003e on the same Fly Machine!\u003c/p\u003e\n\u003c/div\u003e\n\n___________\n\n\u003cdiv align=\"center\"\u003e\n  \u003cpicture\u003e\n    \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"https://github.com/fly-apps/ollama-open-webui/assets/3727384/471dc098-e5f5-4d02-813d-c77fe891bf58\"\u003e\n    \u003cimg src=\"https://github.com/fly-apps/ollama-open-webui/assets/3727384/22e90e1e-7a48-4628-8444-8135a0049adb\"\u003c/img\u003e\n  \u003c/picture\u003e\n\u003c/div\u003e\n\n## Deploy\n\nEveryone loves a one-liner — let's clone the repo and deploy the app with [flyctl](https://fly.io/docs/hands-on/install-flyctl/): \n\n```bash\nfly launch --from https://github.com/fly-apps/ollama-open-webui\n```\n\nThat's it! When you visit `https://[app].fly.dev` you should see the Open WebUI interface where you can log in and create the initial admin user. You can then optionally disable signups and make the app private by setting `ENABLE_SIGNUP = \"false\"` in your fly.toml [`env` variables section](https://fly.io/docs/reference/configuration/#the-env-variables-section).\n\n\u003e [!IMPORTANT]  \n\u003e By default, the app runs on Fly GPUs — Nvidia L40s to be exact. This can be customized in the fly.toml [`vm` settings](https://github.com/fly-apps/ollama-open-webui/blob/e168239c26fb2548ee26d1e44e1df3ab1278497d/fly.toml#L26). It will _probably_ run on a standard Fly Machine because Ollama does leverage llama.cpp — but performance will be drastically reduced.\n\n## Scaling to Zero\n\nBy default, the app does scale-to-zero. This is recommended (especially with GPUs) to save on costs. When the app receives a new request from the proxy, the Machine will boot in ~3s with the Web UI server ready to serve requests in ~15s. Loading models into VRAM can take a bit longer, depending on the size of the model.\n\n## Having trouble?\n\nCreate an issue or ask a question here: https://community.fly.io/\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffly-apps%2Follama-open-webui","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffly-apps%2Follama-open-webui","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffly-apps%2Follama-open-webui/lists"}