{"id":13489979,"url":"https://github.com/camenduru/text-generation-webui-colab","last_synced_at":"2025-05-15T13:08:21.859Z","repository":{"id":152195978,"uuid":"625363586","full_name":"camenduru/text-generation-webui-colab","owner":"camenduru","description":"A colab gradio web UI for running Large Language Models","archived":false,"fork":false,"pushed_at":"2023-12-22T18:52:49.000Z","size":165,"stargazers_count":2100,"open_issues_count":6,"forks_count":369,"subscribers_count":31,"default_branch":"main","last_synced_at":"2025-05-11T00:31:45.985Z","etag":null,"topics":["alpaca","colab","colab-notebook","colaboratory","gradio","koala","lama","llama","llamas","llm","vicuna"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"unlicense","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/camenduru.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null},"funding":{"github":null,"patreon":"camenduru","open_collective":null,"ko_fi":"camenduru","tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"otechie":null,"lfx_crowdfunding":null,"custom":null}},"created_at":"2023-04-08T22:04:37.000Z","updated_at":"2025-05-08T00:15:15.000Z","dependencies_parsed_at":null,"dependency_job_id":"380346a3-d283-446d-8de5-56e1bdd39119","html_url":"https://github.com/camenduru/text-generation-webui-colab","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/camenduru%2Ftext-generation-webui-colab","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/camenduru%2Ftext-generation-webui-colab/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/camenduru%2Ftext-generation-webui-colab/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/camenduru%2Ftext-generation-webui-colab/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/camenduru","download_url":"https://codeload.github.com/camenduru/text-generation-webui-colab/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254346624,"owners_count":22055808,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["alpaca","colab","colab-notebook","colaboratory","gradio","koala","lama","llama","llamas","llm","vicuna"],"created_at":"2024-07-31T19:00:38.902Z","updated_at":"2025-05-15T13:08:16.850Z","avatar_url":"https://github.com/camenduru.png","language":"Jupyter Notebook","funding_links":["https://patreon.com/camenduru","https://ko-fi.com/camenduru"],"categories":["Jupyter Notebook"],"sub_categories":[],"readme":"🐣 Please follow me for new updates https://twitter.com/camenduru \u003cbr /\u003e\n🔥 Please join our discord server https://discord.gg/k5BwmmvJJU \u003cbr /\u003e\n🥳 Please join my patreon community https://patreon.com/camenduru \u003cbr /\u003e\n\n## 🚦 WIP 🚦\n\n## 🦒 Colab\n| colab | Info - Model Page\n| --- | --- |\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/vicuna-13b-GPTQ-4bit-128g.ipynb) | vicuna-13b-GPTQ-4bit-128g \u003cbr /\u003e https://vicuna.lmsys.org\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/vicuna-13B-1.1-GPTQ-4bit-128g.ipynb) | vicuna-13B-1.1-GPTQ-4bit-128g \u003cbr /\u003e https://vicuna.lmsys.org\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/stable-vicuna-13B-GPTQ-4bit-128g.ipynb) | stable-vicuna-13B-GPTQ-4bit-128g \u003cbr /\u003e https://huggingface.co/CarperAI/stable-vicuna-13b-delta\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/gpt4-x-alpaca-13b-native-4bit-128g.ipynb) | gpt4-x-alpaca-13b-native-4bit-128g \u003cbr /\u003e https://huggingface.co/chavinlo/gpt4-x-alpaca\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/pyg-7b-GPTQ-4bit-128g.ipynb) | pyg-7b-GPTQ-4bit-128g \u003cbr /\u003e https://huggingface.co/Neko-Institute-of-Science/pygmalion-7b\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/koala-13B-GPTQ-4bit-128g.ipynb) | koala-13B-GPTQ-4bit-128g \u003cbr /\u003e https://bair.berkeley.edu/blog/2023/04/03/koala\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/oasst-llama13b-GPTQ-4bit-128g.ipynb) | oasst-llama13b-GPTQ-4bit-128g \u003cbr /\u003e https://open-assistant.io\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/wizard-lm-uncensored-7b-GPTQ-4bit-128g.ipynb) | wizard-lm-uncensored-7b-GPTQ-4bit-128g \u003cbr /\u003e https://github.com/nlpxucan/WizardLM\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/mpt-storywriter-7b-GPTQ-4bit-128g.ipynb) | mpt-storywriter-7b-GPTQ-4bit-128g \u003cbr /\u003e https://www.mosaicml.com\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/wizard-lm-uncensored-13b-GPTQ-4bit-128g.ipynb) | wizard-lm-uncensored-13b-GPTQ-4bit-128g \u003cbr /\u003e https://github.com/nlpxucan/WizardLM\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/pyg-13b-GPTQ-4bit-128g.ipynb) | pyg-13b-GPTQ-4bit-128g \u003cbr /\u003e https://huggingface.co/PygmalionAI/pygmalion-13b\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/falcon-7b-instruct-GPTQ-4bit.ipynb) | falcon-7b-instruct-GPTQ-4bit \u003cbr /\u003e https://falconllm.tii.ae/\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/wizard-lm-13b-1.1-GPTQ-4bit-128g.ipynb) | wizard-lm-13b-1.1-GPTQ-4bit-128g \u003cbr /\u003e https://github.com/nlpxucan/WizardLM\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-7b-chat-GPTQ-4bit.ipynb) | llama-2-7b-chat-GPTQ-4bit (4bit) \u003cbr /\u003e https://ai.meta.com/llama/\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat-GPTQ-4bit.ipynb) | llama-2-13b-chat-GPTQ-4bit (4bit) \u003cbr /\u003e https://ai.meta.com/llama/ \u003cbr /\u003e 🚦 WIP 🚦 please try llama-2-13b-chat or llama-2-7b-chat or llama-2-7b-chat-GPTQ-4bit\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-7b-chat.ipynb) | llama-2-7b-chat (16bit) \u003cbr /\u003e https://ai.meta.com/llama/\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat.ipynb) | llama-2-13b-chat (8bit) \u003cbr /\u003e https://ai.meta.com/llama/\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/redmond-puffin-13b-GPTQ-4bit.ipynb) | redmond-puffin-13b-GPTQ-4bit (4bit) \u003cbr /\u003e https://huggingface.co/NousResearch/Redmond-Puffin-13B\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/stable-beluga-7b.ipynb) | stable-beluga-7b (16bit) \u003cbr /\u003e https://huggingface.co/stabilityai/StableBeluga-7B\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/doctor-gpt-7b.ipynb) | doctor-gpt-7b (16bit) \u003cbr /\u003e https://ai.meta.com/llama/ (https://github.com/llSourcell/DoctorGPT)\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/code-llama-7b.ipynb) | code-llama-7b (16bit) \u003cbr /\u003e https://github.com/facebookresearch/codellama\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/code-llama-instruct-7b.ipynb) | code-llama-instruct-7b (16bit) \u003cbr /\u003e https://github.com/facebookresearch/codellama\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/code-llama-python-7b.ipynb) | code-llama-python-7b (16bit) \u003cbr /\u003e https://github.com/facebookresearch/codellama\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/mistral-7b-Instruct-v0.1-8bit.ipynb) | mistral-7b-Instruct-v0.1-8bit (8bit) \u003cbr /\u003e https://mistral.ai/\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/mytho-max-l2-13b-GPTQ.ipynb) | mytho-max-l2-13b-GPTQ (4bit) \u003cbr /\u003e https://huggingface.co/Gryphe/MythoMax-L2-13b\n\n## 🦒 Colab Pro\nAccording to the Facebook Research LLaMA license (Non-commercial bespoke license), maybe we cannot use this model with a Colab Pro account.\nBut Yann LeCun said \"GPL v3\" (https://twitter.com/ylecun/status/1629189925089296386) I am a little confused. Is it possible to use this with a non-free Colab Pro account?\n\n## Tutorial\nhttps://www.youtube.com/watch?v=kgA7eKU1XuA\n\n#### ⚠ If you encounter an `IndexError: list index out of range` error, please set the models instruction template.\n![Screenshot 2023-08-28 165206](https://github.com/camenduru/text-generation-webui-colab/assets/54370274/7f619737-eb3e-4368-9b03-65836d1207f0)\n\n## Text Generation Web UI\n[https://github.com/oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui) (Thanks to @oobabooga ❤)\n\n## Models License\n| Model | License\n| --- | --- |\nvicuna-13b-GPTQ-4bit-128g | From https://vicuna.lmsys.org: The online demo is a research preview intended for non-commercial use only, subject to the model [License](https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md) of LLaMA, Terms of Use of the data generated by OpenAI, and Privacy Practices of ShareGPT. Please contact us If you find any potential violation. The code is released under the Apache License 2.0.\ngpt4-x-alpaca-13b-native-4bit-128g | https://huggingface.co/chavinlo/alpaca-native -\u003e https://huggingface.co/chavinlo/alpaca-13b -\u003e https://huggingface.co/chavinlo/gpt4-x-alpaca\nllama-2 | https://ai.meta.com/llama/ Llama 2 is available for free for research and commercial use. 🥳\n\n## Special Thanks\nThanks to facebookresearch ❤ for https://github.com/facebookresearch/llama \u003cbr /\u003e\nThanks to lmsys ❤ for https://huggingface.co/lmsys/vicuna-13b-delta-v0 \u003cbr /\u003e\nThanks to anon8231489123 ❤ for https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/lmsys/vicuna-13b-delta-v0) \u003cbr /\u003e\nThanks to tatsu-lab ❤ for https://github.com/tatsu-lab/stanford_alpaca \u003cbr /\u003e\nThanks to chavinlo ❤ for https://huggingface.co/chavinlo/gpt4-x-alpaca \u003cbr /\u003e\nThanks to qwopqwop200 ❤ for https://github.com/qwopqwop200/GPTQ-for-LLaMa \u003cbr /\u003e\nThanks to tsumeone ❤ for https://huggingface.co/tsumeone/gpt4-x-alpaca-13b-native-4bit-128g-cuda (GPTQ 4bit quantization of: https://huggingface.co/chavinlo/gpt4-x-alpaca) \u003cbr /\u003e\nThanks to transformers ❤ for https://github.com/huggingface/transformers \u003cbr /\u003e\nThanks to gradio-app ❤ for https://github.com/gradio-app/gradio \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/stable-vicuna-13B-GPTQ \u003cbr /\u003e\nThanks to Neko-Institute-of-Science ❤ for https://huggingface.co/Neko-Institute-of-Science/pygmalion-7b \u003cbr /\u003e\nThanks to gozfarb ❤ for https://huggingface.co/gozfarb/pygmalion-7b-4bit-128g-cuda (GPTQ 4bit quantization of: https://huggingface.co/Neko-Institute-of-Science/pygmalion-7b) \u003cbr /\u003e\nThanks to young-geng ❤ for https://huggingface.co/young-geng/koala \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/koala-13B-GPTQ-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/young-geng/koala) \u003cbr /\u003e\nThanks to dvruette ❤ for https://huggingface.co/dvruette/oasst-llama-13b-2-epochs \u003cbr /\u003e\nThanks to gozfarb ❤ for https://huggingface.co/gozfarb/oasst-llama13b-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/dvruette/oasst-llama-13b-2-epochs) \u003cbr /\u003e\nThanks to ehartford ❤ for https://huggingface.co/ehartford/WizardLM-7B-Uncensored \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/WizardLM-7B-uncensored-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/ehartford/WizardLM-7B-Uncensored) \u003cbr /\u003e\nThanks to mosaicml ❤ for https://huggingface.co/mosaicml/mpt-7b-storywriter \u003cbr /\u003e\nThanks to OccamRazor ❤ for https://huggingface.co/OccamRazor/mpt-7b-storywriter-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/mosaicml/mpt-7b-storywriter) \u003cbr /\u003e\nThanks to ehartford ❤ for https://huggingface.co/ehartford/WizardLM-13B-Uncensored \u003cbr /\u003e\nThanks to ausboss ❤ for https://huggingface.co/ausboss/WizardLM-13B-Uncensored-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/ehartford/WizardLM-13B-Uncensored) \u003cbr /\u003e\nThanks to PygmalionAI ❤ for https://huggingface.co/PygmalionAI/pygmalion-13b \u003cbr /\u003e\nThanks to notstoic ❤ for https://huggingface.co/notstoic/pygmalion-13b-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/PygmalionAI/pygmalion-13b) \u003cbr /\u003e\nThanks to WizardLM ❤ for https://huggingface.co/WizardLM/WizardLM-13B-V1.1 \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/WizardLM-13B-V1.1-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/WizardLM/WizardLM-13B-V1.1) \u003cbr /\u003e\nThanks to meta-llama ❤ for https://huggingface.co/meta-llama/Llama-2-7b-chat-hf \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/Llama-2-7b-Chat-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) \u003cbr /\u003e\nThanks to meta-llama ❤ for https://huggingface.co/meta-llama/Llama-2-13b-chat-hf \u003cbr /\u003e\nThanks to localmodels ❤ for https://huggingface.co/localmodels/Llama-2-13B-Chat-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) \u003cbr /\u003e\nThanks to NousResearch ❤ for https://huggingface.co/NousResearch/Redmond-Puffin-13B \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/Redmond-Puffin-13B-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/NousResearch/Redmond-Puffin-13B) \u003cbr /\u003e\nThanks to llSourcell ❤ for https://huggingface.co/llSourcell/medllama2_7b \u003cbr /\u003e\nThanks to MetaAI ❤ for https://ai.meta.com/research/publications/code-llama-open-foundation-models-for-code/ \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/CodeLlama-7B-fp16 \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-fp16 \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/CodeLlama-7B-Python-fp16 \u003cbr /\u003e\nThanks to MistralAI ❤ for https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 \u003cbr /\u003e\nThanks to Gryphe ❤ for https://huggingface.co/Gryphe/MythoMax-L2-13b \u003cbr /\u003e\nThanks to TheBloke ❤ for https://huggingface.co/TheBloke/MythoMax-L2-13B-GPTQ (GPTQ 4bit quantization of: https://huggingface.co/Gryphe/MythoMax-L2-13b)\u003cbr /\u003e\n\n## Medical Advice Disclaimer\nDISCLAIMER: THIS WEBSITE DOES NOT PROVIDE MEDICAL ADVICE\nThe information, including but not limited to, text, graphics, images and other material contained on this website are for informational purposes only. No material on this site is intended to be a substitute for professional medical advice, diagnosis or treatment. Always seek the advice of your physician or other qualified health care provider with any questions you may have regarding a medical condition or treatment and before undertaking a new health care regimen, and never disregard professional medical advice or delay in seeking it because of something you have read on this website.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcamenduru%2Ftext-generation-webui-colab","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcamenduru%2Ftext-generation-webui-colab","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcamenduru%2Ftext-generation-webui-colab/lists"}