{"id":31048962,"url":"https://github.com/jalberty2018/run-text-generation-webui","last_synced_at":"2026-04-16T11:02:35.575Z","repository":{"id":310674455,"uuid":"1039096705","full_name":"jalberty2018/Run-text-generation-webui","owner":"jalberty2018","description":"Docker image for oobabooga text-generation-webui","archived":false,"fork":false,"pushed_at":"2025-08-19T14:03:32.000Z","size":21,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-08-19T16:22:51.066Z","etag":null,"topics":["docker-image","llm-inference","oobabooga"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jalberty2018.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-08-16T13:26:18.000Z","updated_at":"2025-08-19T14:03:35.000Z","dependencies_parsed_at":"2025-08-21T22:47:47.940Z","dependency_job_id":null,"html_url":"https://github.com/jalberty2018/Run-text-generation-webui","commit_stats":null,"previous_names":["jalberty2018/run-text-generation-webui"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/jalberty2018/Run-text-generation-webui","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jalberty2018%2FRun-text-generation-webui","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jalberty2018%2FRun-text-generation-webui/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jalberty2018%2FRun-text-generation-webui/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jalberty2018%2FRun-text-generation-webui/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jalberty2018","download_url":"https://codeload.github.com/jalberty2018/Run-text-generation-webui/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jalberty2018%2FRun-text-generation-webui/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":275169634,"owners_count":25417333,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-14T02:00:10.474Z","response_time":75,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker-image","llm-inference","oobabooga"],"created_at":"2025-09-14T21:25:11.814Z","updated_at":"2026-04-16T11:02:35.566Z","avatar_url":"https://github.com/jalberty2018.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Run text-generation-webui on [RunPod.io](https://runpod.io?ref=se4tkc5o)\n\n[![Docker Image Version](https://img.shields.io/docker/v/ls250824/run-text-generation-webui)](https://hub.docker.com/r/ls250824/run-text-generation-webui)\n\n## This pod downloads models as specified in the **environment variables**\n\n- Models are automatically downloaded based on the specified paths in the environment configuration.  \n- Authentication credentials can be set via secrets for:  \n  - **Code server** authentication (not possible to switch off). \n  - **Hugging Face** tokens for model access.\n  - **text-generation-webui** gradio authentication.  \n\n## 📦 Template Deployment\n\n👉 [**One-click Deploy on RunPod**](https://console.runpod.io/deploy?template=u62v7rqcqw\u0026ref=se4tkc5o)\n\n## Hardware Requirements  \n \n- **Recommended GPUs**: Nvidia RTX A4500, A40\n- **Storage**:  \n  - **Volume**: 80GB (`/workspace`)  \n  - **Pod Volume**: 5Gb  \n\n## Available Images\n\n### Base Images \n\n#### ls250824/pytorch-cuda-ubuntu-runtime\n\t\n[![Docker Image Version](https://img.shields.io/docker/v/ls250824/pytorch-cuda-ubuntu-runtime)](https://hub.docker.com/r/ls250824/pytorch-cuda-ubuntu-runtime)\n\n### Custom Build: \n\n```bash\ndocker pull ls250824/run-text-generation-webui:\u003cversion\u003e\n```\n\n## Environment Variables  \n\n### **Authentication Tokens**  \n\n| Token        | Environment Variable | Example | Required |\n|--------------|----------------------|---------|----------|\n| Hugging face  | `HF_TOKEN`           | token | Optional  | \n| Code Server  | `PASSWORD`           | password | ✅ Yes |\n| text-generation-webui       | `GRADIO_AUTH`        | user:password | Optional |\n\n## 📦 **GGUF Model Downloads**\n\n| Model Type     | Hugging Face URL Variable | GGUF File Variable       |\n|----------------|---------------------------|---------------------------|\n| GGUF Model     | `HF_MODEL_GGUF[1-6]`          | `HF_MODEL_GGUF_FILE[1-6]`     |\n\n## 📦 **MMPROJ Downloads (multi modality)**\n\n| Model Type     | Hugging Face URL Variable | GGUF File Variable       |\n|----------------|---------------------------|---------------------------|\n| GGUF MMPROJ     | `HF_MMPROJ_GGUF[1-6]`          | `HF_MMPROJ_GGUF_FILE[1-6]`     |\n\n## 🤖 **Transformers Model Downloads**\n\n| Model Type              | Hugging Face URL Variable | Destination Subfolder Variable |\n|-------------------------|----------------------------|----------------------------------|\n| Transformers   | `HF_MODEL[1-6]`                | `HF_MODEL_DIR[1-6]`                 |\n\n## 🤖 **EXL Model Downloads**\n\n| Model Type            |    Hugging Face URL Variable | Revision | Destination Subfolder Variable |\n|-------------------------|----------|------------------|----------------------------------|\n| EXL    | `HF_EXL1`  |  `HF_EXL_REVISION[1-6]`  |  `HF_EXL_DIR[1-6]`                 |\n\n\n## Connection options \n\n### Services\n\n| Service         | Port          |\n|-----------------|---------------| \n| **Code Server** | `9000` (HTTP) |\n| **SSH/SCP**     | `22`   (TCP)  |\n| **Gradio**      | `7860` (HTTP) |\n\n## Website models\n\n- [Huggingface](https://huggingface.co/)\n\n## Websites software Github\n\n- [Code server](https://github.com/coder/code-server)\n- [text-generation-webui](https://github.com/oobabooga/text-generation-webui)\n- [Multi modality](https://github.com/oobabooga/text-generation-webui/wiki/Multimodal-Tutorial)\n\n## Manual provisioning\n\n[example models](provisioning/provisioning.md)\n\n## Building the Docker Image \n\nThis is not possible on [runpod.io](https://runpod.io?ref=se4tkc5o) use local hardware.\nYou can build and push the image to Docker Hub using the `build-docker.py` script.\n\n### `build-docker.py` script options\n\n| Option         | Description                                         | Default                |\n|----------------|-----------------------------------------------------|------------------------|\n| `--username`   | Docker Hub username                                 | Current user           |\n| `--tag`        | Tag to use for the image                            | Today's date           |\n| `--latest`     | If specified, also tags and pushes as `latest`      | Not enabled by default |\n\n### Build \u0026 push Command\n\nRun the following command to clone the repository and build the image:\n\n```bash\ngit clone https://github.com/jalberty2018/run-text-generation-webui.git\ncp run-text-generation-webui/build-docker.py ..\n\nexport DOCKER_BUILDKIT=1\nexport COMPOSE_DOCKER_CLI_BUILD=1\n\npython build-docker.py \\\n--username=\u003cyour_dockerhub_username\u003e \\\n--tag=\u003ccustom_tag\u003e \\ \nrun-text-generation-webui\n```\n\nNote: If you want to push the image with the latest tag, add the --latest flag at the end.\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjalberty2018%2Frun-text-generation-webui","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjalberty2018%2Frun-text-generation-webui","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjalberty2018%2Frun-text-generation-webui/lists"}