Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/camenduru/LLaVA-colab

Last synced: about 2 months ago
JSON representation

Host: GitHub
URL: https://github.com/camenduru/LLaVA-colab
Owner: camenduru
Created: 2023-10-07T07:06:52.000Z (12 months ago)
Default Branch: main
Last Pushed: 2023-12-22T19:26:44.000Z (9 months ago)
Last Synced: 2024-07-04T22:58:23.197Z (2 months ago)
Language: Jupyter Notebook
Size: 50.8 KB
Stars: 188
Watchers: 6
Forks: 27
Open Issues: 3
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

        🐣 Please follow me for new updates https://twitter.com/camenduru 


🔥 Please join our discord server https://discord.gg/k5BwmmvJJU 


🥳 Please join my patreon community https://patreon.com/camenduru 


## 🦒 Colab

| Colab | Info

| --- | --- |

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/LLaVA-colab/blob/main/LLaVA_13b_4bit_colab.ipynb) | 🌋 LLaVA_13b_4bit_colab 13B (4bit)

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/LLaVA-colab/blob/main/LLaVA_13b_4bit_vanilla_colab.ipynb) | 🌋LLaVA_13b_4bit_vanilla_colab 13B (4bit) (without gradio)

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/LLaVA-colab/blob/main/LLaVA_13b_4bit_caption_colab.ipynb) | 🌋LLaVA_13b_4bit_caption_colab 13B (4bit) (without gradio - image caption loop)

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/LLaVA-colab/blob/main/LLaVA_7b_8bit_colab.ipynb) | 🌋 LLaVA_7b_8bit_colab 7B (8bit)

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/LLaVA-colab/blob/main/LLaVA_7b_colab.ipynb) | 🌋 LLaVA_7b_colab 7B (16bit) (Pro High-RAM 😐 22GB RAM 14GB VRAM)

## ⚠ Tutorial

https://www.youtube.com/watch?v=o7zQAa0NPds

After clicking the third cell, please wait for the model to load. 


`~14.7GB` for `16bit` `~8GB` for `8bit` ~5 minutes 


We will not receive any output because it will be running in another thread. 


![Screenshot 2023-10-09 210109a](https://github.com/camenduru/LLaVA-colab/assets/54370274/396b7a05-3660-4117-87bc-cc9384d627f2)

## Main Repo

https://github.com/haotian-liu/LLaVA

## Paper

https://arxiv.org/abs/2304.08485

## Page

https://llava-vl.github.io/

## Output

![Screenshot 2023-10-07 115057](https://github.com/camenduru/LLaVA-colab/assets/54370274/fbf25306-7dcd-4100-b799-52343eec7bed)

![Screenshot 2023-10-14 164638](https://github.com/camenduru/LLaVA-colab/assets/54370274/c54880a0-0b6d-4916-aa48-e0387c7cdb6a)