{"id":14964790,"url":"https://github.com/ehristoforu/tensorlm-webui","last_synced_at":"2025-07-13T20:06:22.998Z","repository":{"id":220917944,"uuid":"752440120","full_name":"ehristoforu/TensorLM-webui","owner":"ehristoforu","description":"Simple and modern webui for LLM models based LLaMA.","archived":false,"fork":false,"pushed_at":"2024-09-05T16:24:13.000Z","size":83818,"stargazers_count":6,"open_issues_count":0,"forks_count":5,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-12T19:14:46.522Z","etag":null,"topics":["ai","fooocus","gradio","gradio-python-llm","linux","llamacpp","llm","llm-inference","lm","macos","ml","portable","tensorlm","text-generation-webui","ui","webui","windows"],"latest_commit_sha":null,"homepage":"https://tensorlm-webui.vercel.app","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ehristoforu.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"license.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":null,"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"lfx_crowdfunding":null,"polar":null,"buy_me_a_coffee":null,"custom":["https://www.donationalerts.com/r/ehristoforu","https://www.donationalerts.com/c/ehristoforu"]}},"created_at":"2024-02-03T21:06:55.000Z","updated_at":"2025-01-03T12:34:29.000Z","dependencies_parsed_at":"2024-02-07T14:48:21.208Z","dependency_job_id":"1508e128-8fbf-4ee9-9e76-a62aa7c88ac6","html_url":"https://github.com/ehristoforu/TensorLM-webui","commit_stats":null,"previous_names":["ehristoforu/tensorlm-webui"],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/ehristoforu/TensorLM-webui","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ehristoforu%2FTensorLM-webui","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ehristoforu%2FTensorLM-webui/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ehristoforu%2FTensorLM-webui/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ehristoforu%2FTensorLM-webui/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ehristoforu","download_url":"https://codeload.github.com/ehristoforu/TensorLM-webui/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ehristoforu%2FTensorLM-webui/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265198361,"owners_count":23726449,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","fooocus","gradio","gradio-python-llm","linux","llamacpp","llm","llm-inference","lm","macos","ml","portable","tensorlm","text-generation-webui","ui","webui","windows"],"created_at":"2024-09-24T13:33:47.037Z","updated_at":"2025-07-13T20:06:22.113Z","avatar_url":"https://github.com/ehristoforu.png","language":"Python","funding_links":["https://www.donationalerts.com/r/ehristoforu","https://www.donationalerts.com/c/ehristoforu"],"categories":[],"sub_categories":[],"readme":"# **TensorLM** - webui for LLM models\n\n![preview](assets/preview.png)\n\n*This is Fooocus from the world of Stable Difusion in the world of Text Generation, the same ease of use and the same convenience.*\n\nThis is simple and modern [Gradio](https://gradio.app) webui for LLM models GGML format (.bin) or GGUF format (.gguf) based on LLaMA.\n\nWe can try this app online in very slow demo of 3.0.0 version: \u003ca target=\"_blank\" href=\"https://huggingface.co/spaces/ehristoforu/TensorLM-webui-for-HF\"\u003e\n  \u003cimg src=\"https://huggingface.co/datasets/huggingface/badges/raw/main/open-in-hf-spaces-md-dark.svg\" alt=\"Open In Spaces\"/\u003e\n\u003c/a\u003e\n\n---\nNavigation: \\\n[**Installing**](#installing) \\\n[**Presets**](#presets) \\\n[**Model downloading**](#model-downloading) \\\n[**API**](#api) \\\n[**Args**](#args)\n---\n\n## Fast use\n\nYou can use this webui in cloud service Colab: \u003ca target=\"_blank\" href=\"https://colab.research.google.com/github/ehristoforu/TensorLM-webui/blob/dev/assets/TensorLM_colab.ipynb\"\u003e\n  \u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\n\u003c/a\u003e\n\n## Features\n\n- Simple to use\n- Comfy to work\n- Not demanding on resources\n- Beautiful and pleasant interface\n- Support GGML and GGUF format (.bin and .gguf)\n- Support OpenAI API and MistralAI API\n\n## Installing\n\n### In Windows\n\n[**\u003e\u003e\u003e Portable one-click packege \u003c\u003c\u003c**](https://github.com/ehristoforu/TensorLM-webui/releases/download/latest/latest_TensorLM_portable_win64.7z)\n\nStep-by-step installation:\n  1. Install [Python 3.10.6](https://www.python.org/ftp/python/3.10.6/python-3.10.6-amd64.exe) and [Git](https://github.com/git-for-windows/git/releases/download/v2.44.0.windows.1/Git-2.44.0-64-bit.exe)\n  2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```\n  3. Run ```cd TensorLM-webui```\n  4. Run ```update_mode.bat``` \u0026\u0026 enter 1 and 2\n  5. Run ```start.bat```\n     \nOr download exe installer from [this repo](https://github.com/stableuser/TLM_Installer)\n\n### In MacOS\n\nStep-by-step installation:\n  1. Install [Python 3.10.6](https://www.python.org/ftp/python/3.10.6/python-3.10.6-macos11.pkg) and [Git](https://git-scm.com/download/mac)\n  2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```\n  3. Run ```cd TensorLM-webui```\n  4. Run ```python pip install -r requirements.txt```\n  5. Run ```python webui.py```\n\n### In Linux\n\nStep-by-step installation:\n  1. Install [Python 3.10.6](https://www.python.org/downloads/release/python-3106/) and [Git](https://git-scm.com/download/linux)\n  2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```\n  3. Run ```cd TensorLM-webui```\n  4. Run ```python pip install -r requirements.txt```\n  5. Run ```python webui.py```\n\n## Presets\n\nIn this app there is 23 default presets. \\\n*Thanks, [@mustvlad](https://github.com/mustvlad/ChatGPT-System-Prompts) for system prompts!*\n\nYou can create your custom presets, instruction in ```presets``` folder (it is .md-file).\n\n## Model downloading\n\nWith this interface you don't need to scour the Internet looking for a compatible model; in the \"Tabs\" checkbox and in the \"ModelGet\" tab you can choose which model to download from our verified repository on HuggingFace.\n\n## API \n\n*Warning! Need Internet.*\n\n### OpenAI API\n\n![openai-api-preview](assets/openai-api-preview.png)\n\nYou can use OpenAI API in this UI (select \"OpenAI\" in Mode radio-button).\n\n- You can select the OpenAI model or input your custom OpenAI model\n- You can select the OpenAI endpoint or input your custom OpenAI endpoint\n\n*To enter your OpenAI key go to ```configure.txt``` and input to ```openai_key``` parameter*\n\n### MistralAI API\n\n![mistralai-api-preview](assets/mistralai-api-preview.png)\n\nYou can use MistralAI API (from HuggingFace) in this UI (select \"MistralAI\" in Mode radio-button) for free.\n\n- You can select the MistralAI model or input your custom MistralAI model\n\n\n## Args\n\n*To use args*:\n  - In Windows: edit start.bat with Notepad and edit line with ```python webui.py``` to ```python webui.py [Your args]```, for ex. ```python webui.py --inbrowser```\n  - In MacOS \u0026 Linux: run ```python webui.py``` with args - ```python webui.py {Your args}```, for ex. ```python webui.py --inbrowser```\n\n### Args list\n\n`--inbrowser --share --lowvram --debug --quiet`\n\n## Forks\n\nWhile there are no forks 😔, perhaps you will be the first who can significantly improve this application!\n\n## ![](https://img.shields.io/github/license/ehristoforu/TensorLM-webui.svg)\n\n## Citation\n```bibtex\n    @software{ehristoforu_TensorLM-webui_2024,\n        author = {ehristoforu},\n        month = apr,\n        title = {{TensorLM-webui}},\n        url = {https://github.com/ehristoforu/TensorLM-webui},\n        year = {2024}\n    }\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fehristoforu%2Ftensorlm-webui","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fehristoforu%2Ftensorlm-webui","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fehristoforu%2Ftensorlm-webui/lists"}