{"id":50885299,"url":"https://github.com/ashleykleynhans/textgen-docker","last_synced_at":"2026-06-15T16:33:16.322Z","repository":{"id":351716544,"uuid":"652259049","full_name":"ashleykleynhans/textgen-docker","owner":"ashleykleynhans","description":"Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models with support for multiple inference backends.","archived":false,"fork":false,"pushed_at":"2026-05-21T08:50:30.000Z","size":320,"stargazers_count":4,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-06-07T09:05:04.325Z","etag":null,"topics":["api","docker","docker-image","gradio","llama","llama-cpp","llm","runpod","textgen","webui"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ashleykleynhans.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null},"funding":{"github":"ashleykleynhans","buy_me_a_coffee":"ashleyk"}},"created_at":"2023-06-11T15:35:26.000Z","updated_at":"2026-05-21T08:50:35.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/ashleykleynhans/textgen-docker","commit_stats":null,"previous_names":["ashleykleynhans/textgen-docker"],"tags_count":91,"template":false,"template_full_name":null,"purl":"pkg:github/ashleykleynhans/textgen-docker","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashleykleynhans%2Ftextgen-docker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashleykleynhans%2Ftextgen-docker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashleykleynhans%2Ftextgen-docker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashleykleynhans%2Ftextgen-docker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ashleykleynhans","download_url":"https://codeload.github.com/ashleykleynhans/textgen-docker/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ashleykleynhans%2Ftextgen-docker/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34101070,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-09T02:00:06.510Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","docker","docker-image","gradio","llama","llama-cpp","llm","runpod","textgen","webui"],"created_at":"2026-06-15T16:33:15.788Z","updated_at":"2026-06-15T16:33:16.311Z","avatar_url":"https://github.com/ashleykleynhans.png","language":"Python","funding_links":["https://github.com/sponsors/ashleykleynhans","https://buymeacoffee.com/ashleyk","https://www.buymeacoffee.com/ashleyk"],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n# Docker image for TextGen: The original local LLM interface. Text, vision, tool-calling, training. UI + API, 100% offline and private.\n\n![Docker Pulls](https://img.shields.io/docker/pulls/ashleykza/textgen?style=for-the-badge\u0026logo=docker\u0026label=Docker%20Pulls\u0026link=https%3A%2F%2Fhub.docker.com%2Frepository%2Fdocker%2Fashleykza%2Ftextgen%2Fgeneral)\n![Template Version](https://img.shields.io/github/v/tag/ashleykleynhans/textgen-docker?style=for-the-badge\u0026logo=data%3Aimage%2Fsvg%2Bxml%3Bbase64%2CPD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPCEtLSBHZW5lcmF0b3I6IEFkb2JlIElsbHVzdHJhdG9yIDI2LjUuMywgU1ZHIEV4cG9ydCBQbHVnLUluIC4gU1ZHIFZlcnNpb246IDYuMDAgQnVpbGQgMCkgIC0tPgo8c3ZnIHZlcnNpb249IjEuMSIgaWQ9IkxheWVyXzEiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyIgeG1sbnM6eGxpbms9Imh0dHA6Ly93d3cudzMub3JnLzE5OTkveGxpbmsiIHg9IjBweCIgeT0iMHB4IgoJIHZpZXdCb3g9IjAgMCAyMDAwIDIwMDAiIHN0eWxlPSJlbmFibGUtYmFja2dyb3VuZDpuZXcgMCAwIDIwMDAgMjAwMDsiIHhtbDpzcGFjZT0icHJlc2VydmUiPgo8c3R5bGUgdHlwZT0idGV4dC9jc3MiPgoJLnN0MHtmaWxsOiM2NzNBQjc7fQo8L3N0eWxlPgo8Zz4KCTxnPgoJCTxwYXRoIGNsYXNzPSJzdDAiIGQ9Ik0xMDE3Ljk1LDcxMS4wNGMtNC4yMiwyLjM2LTkuMTgsMy4wMS0xMy44NiwxLjgyTDM4Ni4xNyw1NTUuM2MtNDEuNzItMTAuNzYtODYuMDItMC42My0xMTYuNiwyOS43MwoJCQlsLTEuNCwxLjM5Yy0zNS45MiwzNS42NS0yNy41NSw5NS44LDE2Ljc0LDEyMC4zbDU4NC4zMiwzMjQuMjNjMzEuMzYsMTcuNCw1MC44Miw1MC40NSw1MC44Miw4Ni4zMnY4MDYuNzYKCQkJYzAsMzUuNDktMzguNDEsNTcuNjctNjkuMTUsMzkuOTRsLTcwMy4xNS00MDUuNjRjLTIzLjYtMTMuNjEtMzguMTMtMzguNzgtMzguMTMtNjYuMDJWNjY2LjYzYzAtODcuMjQsNDYuNDUtMTY3Ljg5LDEyMS45Mi0yMTEuNjYKCQkJTDkzMy44NSw0Mi4xNWMyMy40OC0xMy44LDUxLjQ3LTE3LjcsNzcuODMtMTAuODRsNzQ1LjcxLDE5NC4xYzMxLjUzLDguMjEsMzYuOTksNTAuNjUsOC41Niw2Ni41N0wxMDE3Ljk1LDcxMS4wNHoiLz4KCQk8cGF0aCBjbGFzcz0ic3QwIiBkPSJNMTUyNy43NSw1MzYuMzhsMTI4Ljg5LTc5LjYzbDE4OS45MiwxMDkuMTdjMjcuMjQsMTUuNjYsNDMuOTcsNDQuNzMsNDMuODIsNzYuMTVsLTQsODU3LjYKCQkJYy0wLjExLDI0LjM5LTEzLjE1LDQ2Ljg5LTM0LjI1LDU5LjExbC03MDEuNzUsNDA2LjYxYy0zMi4zLDE4LjcxLTcyLjc0LTQuNTktNzIuNzQtNDEuOTJ2LTc5Ny40MwoJCQljMC0zOC45OCwyMS4wNi03NC45MSw1NS4wNy05My45Nmw1OTAuMTctMzMwLjUzYzE4LjIzLTEwLjIxLDE4LjY1LTM2LjMsMC43NS00Ny4wOUwxNTI3Ljc1LDUzNi4zOHoiLz4KCQk8cGF0aCBjbGFzcz0ic3QwIiBkPSJNMTUyNC4wMSw2NjUuOTEiLz4KCTwvZz4KPC9nPgo8L3N2Zz4K\u0026logoColor=%23ffffff\u0026label=Template%20Version\u0026color=%23673ab7)\n\n\u003c/div\u003e\n\n## Installs\n\n* Ubuntu 22.04 LTS\n* CUDA 12.8.1\n* Python 3.13\n* Torch 2.9.1\n* [TextGen](\n  https://github.com/oobabooga/textgen) v4.9\n* [Jupyter Lab](https://github.com/jupyterlab/jupyterlab)\n* [code-server](https://github.com/coder/code-server)\n* [runpodctl](https://github.com/runpod/runpodctl)\n* [OhMyRunPod](https://github.com/kodxana/OhMyRunPod)\n* [RunPod File Uploader](https://github.com/kodxana/RunPod-FilleUploader)\n* [croc](https://github.com/schollz/croc)\n* [rclone](https://rclone.org/)\n* speedtest-cli\n* screen\n* tmux\n\n## Available on RunPod\n\nThis image is designed to work on [RunPod](https://runpod.io?ref=2xxro4sy).\nYou can use my custom [RunPod template](\nhttps://runpod.io/console/deploy?template=t9e1ycivcp\u0026ref=2xxro4sy)\nto launch it on RunPod.\n\n## Building the Docker image\n\n\u003e [!NOTE]\n\u003e You will need to edit the `docker-bake.hcl` file and update `REGISTRY_USER`,\n\u003e and `RELEASE`.  You can obviously edit the other values too, but these\n\u003e are the most important ones.\n\n```bash\n# Clone the repo\ngit clone https://github.com/ashleykleynhans/textgen-docker.git\n\n# Log in to Docker Hub\ndocker login\n\n# Build the image, tag the image, and push the image to Docker Hub\ncd textgen-docker\ndocker buildx bake -f docker-bake.hcl --push\n\n# Same as above but customize registry/user/release:\nREGISTRY=ghcr.io REGISTRY_USER=myuser RELEASE=my-release docker buildx \\\n    bake -f docker-bake.hcl --push\n```\n\n## Running Locally\n\n### Install Nvidia CUDA Driver\n\n- [Linux](https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html)\n- [Windows](https://docs.nvidia.com/cuda/cuda-installation-guide-microsoft-windows/index.html)\n\n### Start the Docker container\n\n```bash\ndocker run -d \\\n  --gpus all \\\n  -v /workspace \\\n  -p 3000:3001 \\\n  -p 5000:5001 \\\n  -p 7777:7777 \\\n  -p 8888:8888 \\\n  -p 2999:2999 \\\n  -e VENV_PATH=\"/workspace/venvs/textgen\" \\\n  ashleykza/textgen:latest\n```\n\nYou can obviously substitute the image name and tag with your own.\n\n## Ports\n\n| Connect Port | Internal Port | Description                      |\n|--------------|---------------|----------------------------------|\n| 3000         | 3001          | TextGen                          |\n| 5000         | 5001          | Open AI/Anthropic Compatible API |\n| 7777         | 7777          | Code Server                      |\n| 8888         | 8888          | Jupyter Lab                      |\n| 2999         | 2999          | Runpod File Uploader             |\n\n## Environment Variables\n\n| Variable             | Description                                                   | Default                  |\n|----------------------|---------------------------------------------------------------|--------------------------|\n| VENV_PATH            | Set the path for the Python venv for the app                  | /workspace/venvs/textgen |\n| JUPYTER_LAB_PASSWORD | Set a password for Jupyter lab                                | not set - no password    |\n| DISABLE_AUTOLAUNCH   | Disable Web UI from launching automatically                   | (not set)                |\n| DISABLE_SYNC         | Disable syncing if using a RunPod network volume              | (not set)                |\n| HF_TOKEN             | Hugging Face Hub token for models that require authentication | (not set)                |\n\n## Logs\n\nTextGen creates a log file, and you can tail the log instead of\nkilling the service to view the logs.\n\n| Application | Log file                    |\n|-------------|-----------------------------|\n| TextGen     | /workspace/logs/textgen.log |\n\nFor example:\n\n```bash\ntail -f /workspace/logs/textgen.log\n```\n\n## Community and Contributing\n\nPull requests and issues on [GitHub](https://github.com/ashleykleynhans/textgen-docker)\nare welcome. Bug fixes and new features are encouraged.\n\n## Appreciate my work?\n\n\u003ca href=\"https://www.buymeacoffee.com/ashleyk\" target=\"_blank\"\u003e\u003cimg src=\"https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png\" alt=\"Buy Me A Coffee\" style=\"height: 60px !important;width: 217px !important;\" \u003e\u003c/a\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fashleykleynhans%2Ftextgen-docker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fashleykleynhans%2Ftextgen-docker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fashleykleynhans%2Ftextgen-docker/lists"}