Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/camenduru/MiniGPT-4-colab

Last synced: 4 days ago
JSON representation

Host: GitHub
URL: https://github.com/camenduru/MiniGPT-4-colab
Owner: camenduru
License: unlicense
Created: 2023-04-19T22:25:57.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2023-07-30T22:58:39.000Z (over 1 year ago)
Last Synced: 2024-10-23T07:17:57.232Z (12 days ago)
Language: Jupyter Notebook
Size: 32.2 KB
Stars: 120
Watchers: 3
Forks: 13
Open Issues: 3
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE

Awesome Lists containing this project

README

🐣 Please follow me for new updates https://twitter.com/camenduru

🔥 Please join our discord server https://discord.gg/k5BwmmvJJU

🥳 Please join my patreon community https://patreon.com/camenduru

## 🚦 WIP 🚦

### 🦒 Colab

| Colab | Info
| --- | --- |
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/MiniGPT-4-colab/blob/main/minigpt4_colab.ipynb) | 13B Pro Colab (A100) we need more than 20GB vram 😭
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/MiniGPT-4-colab/blob/main/minigpt4_7b_colab.ipynb) | 7B Pro Colab (T4) we need more than 12GB vram 😀 but we need High-RAM 😐

### Main Repo
https://github.com/Vision-CAIR/MiniGPT-4

### Paper
https://arxiv.org/abs/2304.10592

### Tutorial
https://www.youtube.com/watch?v=WzYBMWc6Zqk

## Models License
| Model | License
| --- | --- |
https://huggingface.co/lmsys/vicuna-13b-delta-v0 | From https://vicuna.lmsys.org: The online demo is a research preview intended for non-commercial use only, subject to the model [License](https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md) of LLaMA, Terms of Use of the data generated by OpenAI, and Privacy Practices of ShareGPT. Please contact us If you find any potential violation. The code is released under the Apache License 2.0.
https://huggingface.co/decapoda-research/llama-13b-hf | https://huggingface.co/decapoda-research/llama-13b-hf/blob/main/LICENSE

## Output

![Screenshot 2023-04-20 182643](https://user-images.githubusercontent.com/54370274/233425725-c768f6f3-5e84-4720-85c1-d5e2390cdea8.png)
![Screenshot 2023-04-20 182019](https://user-images.githubusercontent.com/54370274/233426283-5f3cf719-a84b-42f3-a575-836bbb3d2521.png)

## For RunPod
https://runpod.io/gsc?template=9m2wl11ypy&ref=iqi9iy8y

Please copy-paste the code below into a new notebook. (We need more than 20GB vram)
```py
!apt update
!apt-get install git-lfs
!git lfs install

%env HF_HOME=/workspace/cache/huggingface

!git clone -b dev https://github.com/camenduru/minigpt4
!wget https://huggingface.co/ckpt/minigpt4/resolve/main/minigpt4.pth -O /workspace/minigpt4/checkpoint.pth
!wget https://huggingface.co/ckpt/minigpt4/resolve/main/blip2_pretrained_flant5xxl.pth -O /workspace/minigpt4/blip2_pretrained_flant5xxl.pth

!pip install -q salesforce-lavis
!pip install -q bitsandbytes
!pip install -q accelerate
!pip install -q gradio==3.27.0
!pip install -q git+https://github.com/huggingface/transformers -U

%cd /workspace/minigpt4
!python app.py
```